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Collaborative Statistics: custom version modified by R. Bloom 

This module summarizes the modifications made by Roberta Bloom to the 
modules included in her collection Collaborative Statistics by Roberta 
Bloom, based on the collection Collaborative Statistics, by Susan Dean and 
Dr. Barbara Illowsky, Connexions Web site. 
http://cnx.org/content/col10522/1.29/, Dec 5, 2008 


This module summarizes the modifications made by Roberta Bloom to the 
modules included in the custom textbook collection Collaborative Statistics 
by R. Bloom http://cnx.org/content/col10617/ 
http://cnx.org/content/col10617/ and Homework Book for Collaborative 
Statistics by R. Bloom http://cnx.org/content/col10619/ These custom 
collections are based on the textbook collection Collaborative Statistics, by 
Illowsky, B.and S.Dean, Connexions Web site, 
http://cnx.org/content/col10522/1.29/, Dec 5, 2008, but have been modified, 
as detailed in this module. If future modifications are made to the custom 
collection, this module will be updated to contain current information. 


IMPORTANT NOTE TO STUDENTS OWNING A PRINT COPY OF 
THIS TEXTBOOK: 

This custom version of the Collaborative Statistics textbook by Susan Dean 
and Barbara Illowsky has been modified by Roberta Bloom. The sections 
that are different in this book are listed below, by title, along with a 
description of the changes. Section numbers and page numbers may be 
different also, but the section titles should correspond to the sections in the 
original Dean/Illowsky textbook. 

If you are using a print copy of this textbook and your class instructor 
is NOT Ms. Bloom: 


¢ you need to be aware of the textbook changes listed below 

* you may need to go to Collaborative Statistics collection by S. Dean 
print out the versions of the listed sections as included in the 
Dean/Illowsky collection for this textbook so that you have the same 
version as the rest of your class. 


The custom collection for Ms. Bloom's class has divided the textbook 
into two collections: 


¢ Homework Collection Collaborative Statistics Homework Collection 
contains the formula summary page, the homework problems and the 
review problems 

e Textbook Collection Collaborative Statistics (custom collection 
contains the text and the chapter practices, but not the homework or 
review problems. 

e YOU NEED TO USE BOTH THE HOMEWORK COLLECTION 
AND THE TEXTBOOK COLLECTION FOR MS. BLOOM's 
CLASS. 


List of Modifications: 


Labs and Projects Removed 

The labs and projects have been removed from this modified version of 
Collaborative Statistics. Ms. Bloom posts the labs (and projects, if any) for 
her class on her class website. If you are using this book with another 
instructor you may need to access and print out the labs or projects online 
from the original Dean/Illowsky Collaborative Statistics textbook 
collection: http://cnx.org/content/col10522/latest 

Chapter 1 Data and Sampling 


e Homework: two new homework problems have been added 
Chapter 2 Descriptive Statistics 


e Measuring the Spread of the Data: some revisions in wording and use 
of symbols; introduced terminology for z-score; formulas added; brief 
summary of Chebyshev's Rule and Empirical Rule have been added. 

e Practice 3: Interpreting Percentiles: new section added that was not 
included in the original textbook 

e Homework: Some new homework questions have been added 


Chapter 3: Probability Topics 


e Terminology: wording revisions; discussion of the Law of Large 
Numbers added 


e Independent and Mutually Exclusive Events: wording revisions; add 
additional worked example has been added to illustrate determining 
that two events are not independent 

e Contingency Tables: one example was removed from this section 

e Practice 1: the data has been presented in tabular form 

e Homework: new problems #33 through #41 have been added 


Chapter 4: Discrete Distributions 
¢ Homework: new problems #38 through #43 have been added 
Chapter 5: Continuous Probability Distributions 


e Introduction to Continuous Random Variables: some material has been 
removed 

e Properties of Continuous Random Variables: the concepts of 
probability as area, including graphs illustrating this concept; 
probability density functions, and cumulative distribution functions are 
explained 

¢ Uniform Distribution: Example 4 is new, illustrating the uniform 
distribution when the minimum value is not 0. This replaces the 
example for conditional probability that had been in the original 
module. 

e Practice 1: Uniform Distribution: Problems pertaining to conditional 
probability have been removed from this section 


Chapter 6: The Normal Distribution 
e No changes have been made to this chapter 
Chapter 7: Central Limit Theorem 


e The section for CLT for Sums has been retitled as OPTIONAL 

e Using the Central Limit Theorem : Examples illustrating use of the 
CLT for sums have been removed from this section. 

e Practice: problems pertaining to the CLT for sums were removed from 
the practice 


¢ Homework: Several homework exercises pertaining to the CLT for 
sums have been removed. Several homework exercises have been 
changed to reflect only the CLT for means: parts pertaining to the CLT 
for sums were replaced with new parts or removed. Specific changes 
made: Exercise #1 parts g,i and exercise #15 parts d,e,i and exercise #6 
have been removed. Exercises #7, #11, #13, #22, #23 have been 
modified. Exercise #24 is new. 

e Review: the context of the last problem has been changed 


Chapter 8: Confidence Interval Estimates 


e Confidence Interval for an Unknown Population Mean, Population 
Standard Deviation Known: Normal Distribution: worked examples 
have modified to show the step by step solution using the error bound 
formulas to find the confidence intervals; revised module may also 
contain some revisions in wording. 

¢ Confidence Interval for an Unknown Population Mean, Population 
Standard Deviation Known: Normal Distribution: An additional 
example has been added to the module illustrating how to find the 
mean and the error bound when only the confidence interval is given. 

¢ Confidence Interval for an Unknown Population Mean, Population 
Standard Deviation Unknown: Student t Distribution: worked 
examples have modified to show the step by step solution using the 
error bound formulas to find the confidence intervals; revised module 
may also contain some revisions in wording. 

¢ Confidence Interval for an Unknown Population Proportion: worked 
examples have modified to show the step by step solution using the 
error bound formulas to find the confidence intervals; revised module 
may also contain some revisions in wording. 

e In all 3 sections listed above, the emphasis has been changed to using 
the error bound formulas to calculate the confidence interval rather 
than reliance on the calculators’ interval functions to find the 
confidence interval. 


Chapter 9: Hypothesis Test for a Single Mean or Single Proportion 


e Homework: Some homework exercises have been omitted in this 
revision; the numbering remains unchanged for the remaining 


exercises. The omitted exercises are indicated in the section. 


Chapter 10: Hypothesis Testing: Two Means, Paired Data, Two 
Proportions 


At this time, no changes have been made in this chapter. 


Chapter 11: THe Chi-Square Distribution 


No changes have been made in this chapter. 


Chapter 12: Linear Regression and Correlation 


Sections 12.5 (The Regression Equation), 12.6 (Correlation Coefficient 
and Coefficient of Determination), 12.7 (Testing the Significance of 
the Correlation Coefficient), 12.8 (Prediction), 12.9 Outliers have been 
modified 

Section 12. 5 now contains calculator instructions for the LinRegTTest 
for the TI-83,83+,84+ calculators 

Section 12.6 includes the coefficient of determination that was not 
included in the original section and includes some material that was 
originally in section 12.7 

Section 12.7 now includes both the p-value approach and critical value 
approach to testing the significance of the correlation coefficient. It 
also contains additional information about the assumptions underlying 
the test of significance. Some material originally contained in section 
12.7 has been moved forward to section 12.6 

Section 12.9 includes a graphical method of identifying outliers, in 
addition to the numerical method included in the original version of 
this section 

In the Homework Section, 2 new problems have been added. 


Chpater 13: F Distribution and ANOVA 


No changes have been made in this chapter. 


Hypothesis Test Solution Sheets 


e Hypothesis test solution sheets for chapters 9, 10, 11, 13 will be 
modified and will be made available, appropriately formatted, via links 
on Ms. Bloom's class website. 

e The original solution sheets will be removed from the online 
collection. 


Practice Final Exams 


e Practice Final Exams have been removed from this collection 
e Instead, Practice Final Exams will be made available via links on Ms. 
Bloom's class website 


Preface by S. Dean and B. Illowsky 
This module introduces the Connexions online textbook "Collaborative 
Statistics" by Barbara Illowsky and Susan Dean. 


Welcome to Collaborative Statistics, presented by Connexions. The initial 
section below introduces you to Connexions. If you are familiar with 
Connexions, please skip to About "Collaborative Statistics." 


About Connexions 


Connexions Modular Content 

Connexions (cnx.org) is an online, open access educational resource 
dedicated to providing high quality learning materials free online, free in 
printable PDF format, and at low cost in bound volumes through print-on- 
demand publishing. The Collaborative Statistics textbook is one of many 
collections available to Connexions users. Each collection is composed of a 
number of re-usable learning modules written in the Connexions XML 
markup language. Each module may also be re-used (or 're-purposed') as 
part of other collections and may be used outside of Connexions. Including 
Collaborative Statistics, Connexions currently offers over 6500 modules 
and more than 350 collections. 


The modules of Collaborative Statistics are derived from the original paper 
version of the textbook under the same title, Collaborative Statistics. Each 
module represents a self-contained concept from the original work. 
Together, the modules comprise the original textbook. 


Re-use and Customization 

The Creative Commons (CC) Attribution license applies to all Connexions 
modules. Under this license, any module in Connexions may be used or 
modified for any purpose as long as proper attribution to the original 
author(s) is maintained. Connexions' authoring tools make re-use (or re- 
purposing) easy. Therefore, instructors anywhere are permitted to create 
customized versions of the Collaborative Statistics textbook by editing 
modules, deleting unneeded modules, and adding their own supplementary 
modules. Connexions’ authoring tools keep track of these changes and 
maintain the CC license's required attribution to the original authors. This 


process creates a new collection that can be viewed online, downloaded as a 
single PDF file, or ordered in any quantity by instructors and students as a 
low-cost printed textbook. To start building custom collections, please visit 
the help page, “Create a Collection with Existing Modules”. For a guide to 
authoring modules, please look at the help page, “Create a Module in 
Minutes”. 


Read the book online, print the PDF, or buy a copy of the book. 

To browse the Collaborative Statistics textbook online, visit the collection 
home page at cnx.org/content/col10522/latest. You will then have three 
options. 


1. You may obtain a PDF of the entire textbook to print or view offline 
by clicking on the “Download PDF” link in the “Content Actions” 
box. 

2. You may order a bound copy of the collection by clicking on the 
“Order Printed Copy” button. 

3. You may view the collection modules online by clicking on the “Start 
>>” link, which takes you to the first module in the collection. You can 
then navigate through the subsequent modules by using their “Next 
>>” and “Previous >>” links to move forward and backward in the 
collection. You can jump to any module in the collection by clicking 
on that module’s title in the “Collection Contents” box on the left side 
of the window. If these contents are hidden, make them visible by 
clicking on “[show table of contents]”. 


Accessibility and Section 508 Compliance 
e For information on general Connexions accessibility features, please 
visit http://cnx.org/content/m17212/latest/. 


e For information on accessibility features specific to the Collaborative 
Statistics textbook, please visit http://cnx.org/content/m17211/latest/. 


Version Change History and Errata 


e For a list of modifications, updates, and corrections, please visit 
http://cnx.org/content/m17360/latest/. 


Adoption and Usage 


e The Collaborative Statistics collection has been adopted and 
customized by a number of professors and educators for use in their 
classes. For a list of known versions and adopters, please visit 
http://cnx.org/content/m18261/latest/. 


About “Collaborative Statistics” 


Collaborative Statistics was written by Barbara Illowsky and Susan Dean, 
faculty members at De Anza College in Cupertino, California. The textbook 
was developed over several years and has been used in regular and honors- 
level classroom settings and in distance learning classes. Courses using this 
textbook have been articulated by the University of California for transfer 
of credit. The textbook contains full materials for course offerings, 
including expository text, examples, labs, homework, and projects. A 
Teacher’s Guide is currently available in print form and on the Connexions 
site at http://cnx.org/content/col10547/latest/, and supplemental course 
materials including additional problem sets and video lectures are available 
at http://cnx.org/content/col10586/latest/. The on-line text for each of these 
collections collections will meet the Section 508 standards for accessibility. 


An on-line course based on the textbook was also developed by Illowsky 
and Dean. It has won an award as the best on-line California community 
college course. The on-line course will be available at a later date as a 
collection in Connexions, and each lesson in the on-line course will be 
linked to the on-line textbook chapter. The on-line course will include, in 
addition to expository text and examples, videos of course lectures in 
captioned and non-captioned format. 


The original preface to the book as written by professors Illowsky and 
Dean, now follows: 


This book is intended for introductory statistics courses being taken by 
students at two— and four—year colleges who are majoring in fields other 
than math or engineering. Intermediate algebra is the only prerequisite. The 
book focuses on applications of statistical knowledge rather than the theory 


behind it. The text is named Collaborative Statistics because students learn 
best by doing. In fact, they learn best by working in small groups. The old 
saying “two heads are better than one” truly applies here. 


Our emphasis in this text is on four main concepts: 


e thinking statistically 

e incorporating technology 
¢ working collaboratively 
¢ writing thoughtfully 


These concepts are integral to our course. Students learn the best by 
actively participating, not by just watching and listening. Teaching should 
be highly interactive. Students need to be thoroughly engaged in the 
learning process in order to make sense of statistical concepts. 
Collaborative Statistics provides techniques for students to write across the 
curriculum, to collaborate with their peers, to think statistically, and to 
incorporate technology. 


This book takes students step by step. The text is interactive. Therefore, 
students can immediately apply what they read. Once students have 
completed the process of problem solving, they can tackle interesting and 
challenging problems relevant to today’s world. The problems require the 
students to apply their newly found skills. In addition, technology (TI-83 
graphing calculators are highlighted) is incorporated throughout the text and 
the problems, as well as in the special group activities and projects. The 
book also contains labs that use real data and practices that lead students 
step by step through the problem solving process. 


At De Anza, along with hundreds of other colleges across the country, the 
college audience involves a large number of ESL students as well as 
students from many disciplines. The ESL students, as well as the non-ESL 
students, have been especially appreciative of this text. They find it 
extremely readable and understandable. Collaborative Statistics has been 
used in classes that range from 20 to 120 students, and in regular, honor, 
and distance learning classes. 


Susan Dean 


Barbara Illowsky 


Additional Resources 

This module catalogs several of the resources available for teachers and 
students using the Collaborative Statistics (col10522) textbook and its 
derivatives. This module provides links to the complementary teacher's 
guide, supplemental materials including video lectures and additional 
problem sets, accessibility information, collection version history and 
errata, and a list of related works and teachers who have adopted them for 
their courses. 

Additional Resources Currently Available 


e Glossary 

e View or Download This Textbook Online 
¢ Collaborative Statistics Teacher's Guide 

e Supplemental Materials 

e Video Lectures 

e Version History. 

e Textbook Adoption and Usage 

e Additional Technologies and Notes 

e Accessibility and Section 508 Compliance 


The following section describes some additional resources for learners and 
educators. These modules and collections are all available on the 
Connexions website (http://cnx.org/) and can be viewed online, 
downloaded, printed, or ordered as appropriate. 


Glossary 

This module contains the entire glossary for the Collaborative Statistics 
textbook collection (col10522) since its initial release on 15 July 2008. The 
glossary is located at http://cnx.org/content/m16129/latest/. 


Below are links to additional resources: 
Link to the Statistics Glossary by Dr. Philip Stark, UC Berkeley 


http:// statistics. berkeley.edu/~stark/SticiGui/Text/gloss.htm 


Link to Wikipedia 


http:// http://www.wikipedia.org/ 
(Search on "Glossary of probability and statistics.") 


View or Download This Textbook Online 

The complete contents of this book are available at no cost on the 
Connexions website at http://cnx.org/content/coll0522/latest/, Anybody can 
view this content free of charge either as an online e-book or a 
downloadable PDF file. A low-cost printed version of this textbook is also 
available here. 


Collaborative Statistics Teacher's Guide 

A complementary Teacher's Guide for Collaborative statistics is available 
through Connexions at http://cnx.org/content/col10547/latest/. The 
Teacher's Guide includes suggestions for presenting concepts found 
throughout the book as well as recommended homework assignments. A 
low-cost printed version of this textbook is also available here. 


Supplemental Materials 

This companion to Collaborative Statistics provides a number of additional 
resources for use by students and instructors based on the award winning 
Elementary Statistics Sofia online course, also by textbook authors Barbara 
Illowsky and Susan Dean. This content is designed to complement the 
textbook by providing video tutorials, course management materials, and 
sample problem sets. The Supplemental Materials collection can be found 
at http://cnx.org/content/col10586/latest/. 

Video Lectures 


e Video Lecture 1: Sampling and Data 

e Video Lecture 2: Descriptive Statistics 

e Video Lecture 3: Probability Topics 

e Video Lecture 4: Discrete Distributions 

e Video Lecture 5: Continuous Random Variables 

e Video Lecture 6: The Normal Distribution 

e Video Lecture 7: The Central Limit Theorem 

e Video Lecture 8: Confidence Intervals 

e Video Lecture 9: Hypothesis Testing with a Single Mean 
e Video Lecture 10: Hypothesis Testing with Two Means 
e Video Lecture 11: The Chi-Square Distribution 


e Video Lecture 12: Linear Regression and Correlation 


Version History 

This module contains a listing of changes, updates, and corrections made to 
the Collaborative Statistics textbook collection (col10522) since its initial 
release on 15 July 2008. The Version History is located at 
http://cnx.org/content/m17360/latest/. 


Textbook Adoption and Usage 

This module is designed to track the various derivations of the 
Collaborative Statistics textbook and its various companion resources, as 
well as keep track of educators who have adopted various versions for their 
courses. New adopters are encouraged to provide their contact information 
and describe how they will use this book for their courses. The goal is to 
provide a list that will allow educators using this book to collaborate, share 
ideas, and make suggestions for future development of this text. The 
Adoption and Usage module is located at 
http://cnx.org/content/m18261/latest/. 


Additional Technologies 

In order to provide the most flexible learning resources possible, we invite 
collaboration from all instructors wishing to create customized versions of 
this content for use with other technologies. For instance, you may be 
interested in creating a set of instructions similar to this collection's 
calculator notes. If you would like to contribute to this collection, please 
use the contact the authors with any ideas or materials you have created. 


Accessibility and Section 508 Compliance 


e For information on general Connexions accessibility features, please 
visit http://cnx.org/content/m17212/latest/. 

e For information on accessibility features specific to the Collaborative 
Statistics textbook, please visit http://cnx.org/content/m17211/latest/. 


Author Acknowledgements 
This module contains the author acknowledgements for the Collaborative 
Statistics textbook/collection. 


For this second edition, we appreciate the tremendous feedback from De 
Anza College colleagues and students, as well as from the dozens of faculty 
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Additional thanks: 
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Student Welcome Letter 
Dear Student: 


Have you heard others say, “You’re taking statistics? That’s the hardest 
course I ever took!” They say that, because they probably spent the entire 
course confused and struggling. They were probably lectured to and never 
had the chance to experience the subject. You will not have that problem. 
Let’s find out why. 


There is a Chinese Proverb that describes our feelings about the field of 
Statistics: 


I HEAR, AND I FORGET 
I SEE, AND I REMEMBER 
I DO, AND I UNDERSTAND 


Statistics is a “do” field. In order to learn it, you must “do” it. We have 
structured this book so that you will have hands-on experiences. They will 
enable you to truly understand the concepts instead of merely going through 
the requirements for the course. 


What makes this book different from other texts? First, we have eliminated 
the drudgery of tedious calculations. You might be using computers or 
graphing calculators so that you do not need to struggle with algebraic 
manipulations. Second, this course is taught as a collaborative activity. With 
others in your class, you will work toward the common goal of learning this 
material. 


Here are some hints for success in your class: 


e Work hard and work every night. 

e Form a study group and learn together. 

e Don’t get discouraged - you can do it! 

e As you solve problems, ask yourself, “Does this answer make sense?” 
e Many statistics words have the same meaning as in everyday English. 


¢ Go to your teacher for help as soon as you need it. 

e Don’t get behind. 

e Read the newspaper and ask yourself, “Does this article make sense?” 
e Draw pictures - they truly help! 


Good luck and don’t give up! 


Sincerely, 
Susan Dean and Barbara Illowsky 


De Anza College 
21250 Stevens Creek Blvd. 
Cupertino, California 95014 


Sampling and Data 
This module provides a brief introduction to the field of statistics, including 
examples of how these topics shows up in a variety of real-life examples. 


Student Learning Outcomes 
By the end of this chapter, the student should be able to: 


e Recognize and differentiate between key terms. 
e Apply various types of sampling methods to data collection. 
¢ Create and interpret frequency tables. 


Introduction 


You are probably asking yourself the question, "When and where will I use 
Statistics?". If you read any newspaper or watch television, or use the 
Internet, you will see statistical information. There are statistics about 
crime, sports, education, politics, and real estate. Typically, when you read a 
newspaper article or watch a news program on television, you are given 
sample information. With this information, you may make a decision about 
the correctness of a statement, claim, or "fact." Statistical methods can help 
you make the "best educated guess." 


Since you will undoubtedly be given statistical information at some point in 
your life, you need to know some techniques to analyze the information 
thoughtfully. Think about buying a house or managing a budget. Think 
about your chosen profession. The fields of economics, business, 
psychology, education, biology, law, computer science, police science, and 
early childhood development require at least one course in statistics. 


Included in this chapter are the basic ideas and words of probability and 
Statistics. You will soon understand that statistics and probability work 
together. You will also learn how data are gathered and what "good" data 
are. 


Statistics 

This module introduces the concept of statistics, specifically the ability to 
use Statistics to describe data (descriptive statistics) as well as draw 
conclusions (inferential statistics). An optional classroom exercise is 
included. 


The science of statistics deals with the collection, analysis, interpretation, 
and presentation of data. We see and use data in our everyday lives. 


Optional Collaborative Classroom Exercise 


In your classroom, try this exercise. Have class members write down the 
average time (in hours, to the nearest half-hour) they sleep per night. Your 
instructor will record the data. Then create a simple graph (called a dot 
plot) of the data. A dot plot consists of a number line and dots (or points) 
positioned above the number line. For example, consider the following 
data: 


po.70066.56,50.50.5775009 


The dot plot for this data would be as follows: 
Frequency of Average Time (in Hours) Spent Sleeping per Night 


o 

o Oo 

o oO oO o 
o 0 0 0 °o o o 
5 6 7 8 9 


Does your dot plot look the same as or different from the example? Why? If 
you did the same example in an English class with the same number of 
students, do you think the results would be the same? Why or why not? 


Where do your data appear to cluster? How could you interpret the 
clustering? 


The questions above ask you to analyze and interpret your data. With this 
example, you have begun your study of statistics. 


In this course, you will learn how to organize and summarize data. 
Organizing and summarizing data is called descriptive statistics. Two ways 
to summarize data are by graphing and by numbers (for example, finding an 
average). After you have studied probability and probability distributions, 
you will use formal methods for drawing conclusions from "good" data. 
The formal methods are called inferential statistics. Statistical inference 
uses probability to determine how confident we can be that the conclusions 
are correct. 


Effective interpretation of data (inference) is based on good procedures for 
producing data and thoughtful examination of the data. You will encounter 
what will seem to be too many mathematical formulas for interpreting data. 
The goal of statistics is not to perform numerous calculations using the 
formulas, but to gain an understanding of your data. The calculations can be 
done using a calculator or a computer. The understanding must come from 
you. If you can thoroughly grasp the basics of statistics, you can be more 
confident in the decisions you make in life. 


Levels of Measurement and Statistical Operations 


The way a set of data is measured is called its level of measurement. 
Correct statistical procedures depend on a researcher being familiar with 
levels of measurement. Not every statistical operation can be used with 
every set of data. Data can be classified into four levels of measurement. 
They are (from lowest to highest level): 


e Nominal scale level 
e Ordinal scale level 
e Interval scale level 
e Ratio scale level 


Data that is measured using a nominal scale is qualitative. Categories, 
colors, names, labels and favorite foods along with yes or no responses are 
examples of nominal level data. Nominal scale data are not ordered. For 
example, trying to classify people according to their favorite food does not 
make any sense. Putting pizza first and sushi second is not meaningful. 


Smartphone companies are another example of nominal scale data. Some 
examples are Sony, Motorola, Nokia, Samsung and Apple. This is just a list 
and there is no agreed upon order. Some people may favor Apple but that is 
a matter of opinion. Nominal scale data cannot be used in calculations. 


Data that is measured using an ordinal scale is similar to nominal scale 
data but there is a big difference. The ordinal scale data can be ordered. An 
example of ordinal scale data is a list of the top five national parks in the 
United States. The top five national parks in the United States can be 
ranked from one to five but we cannot measure differences between the 
data. 


Another example using the ordinal scale is a cruise survey where the 
responses to questions about the cruise are “excellent,” “good,” 
“satisfactory” and “unsatisfactory.” These responses are ordered from the 
most desired response by the cruise lines to the least desired. But the 
differences between two pieces of data cannot be measured. Like the 
nominal scale data, ordinal scale data cannot be used in calculations. 


Data that is measured using the interval scale is similar to ordinal level 
data because it has a definite ordering but there is a difference between data. 
The differences between interval scale data can be measured though the 
data does not have a starting point. 


Temperature scales like Celsius (C) and Fahrenheit (F) are measured by 
using the interval scale. In both temperature measurements, 40 degrees is 
equal to 100 degrees minus 60 degrees. Differences make sense. But 0 
degrees does not because, in both scales, 0 is not the absolute lowest 
temperature. Temperatures like -10° F and -15° C exist and are colder than 
0. 


Interval level data can be used in calculations but one type of comparison 
cannot be done. Eighty degrees C is not 4 times as hot as 20° C (nor is 80° 
F 4 times as hot as 20° F). There is no meaning to the ratio of 80 to 20 (or 4 
to 1). 


Data that is measured using the ratio scale takes care of the ratio problem 
and gives you the most information. Ratio scale data is like interval scale 
data but, in addition, it has a O point and ratios can be calculated. For 
example, four multiple choice statistics final exam scores are 80, 68, 20 and 
92 (out of a possible 100 points). The exams were machine-graded. 


The data can be put in order from lowest to highest: 20, 68, 80, 92. 


The differences between the data have meaning. The score 92 is more than 
the score 68 by 24 points. 


Ratios can be calculated. The smallest score for ratio data is 0. So 80 is 4 
times 20. The score of 80 is 4 times better than the score of 20. 


Exercises 


What type of measure scale is being used? Nominal, Ordinal, Interval or 
Ratio. 


1. High school men soccer players classified by their athletic ability: 
Superior, Average, Above average. 
. Baking temperatures for various main dishes: 350, 400, 325, 250, 300 
. The colors of crayons in a 24-crayon box. 
. Social security numbers. 
. Incomes measured in dollars 
. A satisfaction survey of a social website by number: 1 = very satisfied, 
2 = somewhat satisfied, 3 = not satisfied. 
7. Political outlook: extreme left, left-of-center, right-of-center, extreme 
right. 
8. Time of day on an analog watch. 
9. The distance in miles to the closest grocery store. 
10. The dates 1066, 1492, 1644, 1947, 1944. 
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11. The heights of 21 — 65 year-old women. 
12. Common letter grades A, B, C, D, F. 


Answers 1. ordinal, 2. interval, 3. nominal, 4. nominal, 5. ratio, 6. ordinal, 
7. nominal, 8. interval, 9. ratio, 10. interval, 11. ratio, 12. ordinal 


Glossary 


Data 
A set of observations (a set of possible outcomes). Most data can be 
put into two groups: qualitative (hair color, ethnic groups and other 
attributes of the population) and quantitative (distance traveled to 
college, number of children in a family, etc.). Quantitative data can be 
separated into two subgroups: discrete and continuous. Data is 
discrete if it is the result of counting (the number of students of a given 
ethnic group in a class, the number of books on a shelf, etc.). Data is 
continuous if it is the result of measuring (distance traveled, weight of 
luggage, etc.) 


Statistic 
A numerical characteristic of the sample. A statistic estimates the 
corresponding population parameter. For example, the average number 
of full-time students in a 7:30 a.m. class for this term (statistic) is an 
estimate for the average number of full-time students in any class this 
term (parameter). 


Probability 
This module introduces the concept of probability as a mathematical 
measure of randomness, including a number of real-world applications. 


Probability is a mathematical tool used to study randomness. It deals with 
the chance (the likelihood) of an event occurring. For example, if you toss a 
fair coin 4 times, the outcomes may not be 2 heads and 2 tails. However, if 
you toss the same coin 4,000 times, the outcomes will be close to half heads 
and half tails. The expected theoretical probability of heads in any one toss 
is + or 0.5. Even though the outcomes of a few repetitions are uncertain, 
there is a regular pattern of outcomes when there are many repetitions. 
After reading about the English statistician Karl Pearson who tossed a coin 
24,000 times with a result of 12,012 heads, one of the authors tossed a coin 
996 


2,000 times. The results were 996 heads. The fraction >555 is equal to 0.498 


which is very close to 0.5, the expected probability. 


The theory of probability began with the study of games of chance such as 
poker. Predictions take the form of probabilities. To predict the likelihood 
of an earthquake, of rain, or whether you will get an A in this course, we 
use probabilities. Doctors use probability to determine the chance of a 
vaccination causing the disease the vaccination is supposed to prevent. A 
stockbroker uses probability to determine the rate of return on a client's 
investments. You might use probability to decide to buy a lottery ticket or 
not. In your study of statistics, you will use the power of mathematics 
through probability calculations to analyze and interpret your data. 


Glossary 


Probability 
A number between 0 and 1, inclusive, that gives the likelihood that a 
specific event will occur. The foundation of statistics is given by the 
following 3 axioms (by A. N. Kolmogorov, 1930’s): Let S denote the 
sample space and A and B are two events in S . Then: 


© 0< P(A) <1;. 
e If A and B are any two mutually exclusive events, then 
P(A or B) = P(A) + P(B). 


Key Terms 
This module introduces a number of key terms related to statistical 
sampling and data. 


In statistics, we generally want to study a population. You can think of a 
population as an entire collection of persons, things, or objects under study. 
To study the larger population, we select a sample. The idea of sampling is 
to select a portion (or subset) of the larger population and study that portion 
(the sample) to gain information about the population. Data are the result of 
sampling from a population. 


Because it takes a lot of time and money to examine an entire population, 
sampling is a very practical technique. If you wished to compute the overall 
grade point average at your school, it would make sense to select a sample 
of students who attend the school. The data collected from the sample 
would be the students' grade point averages. In presidential elections, 
opinion poll samples of 1,000 to 2,000 people are taken. The opinion poll is 
supposed to represent the views of the people in the entire country. 
Manufacturers of canned carbonated drinks take samples to determine if a 
16 ounce can contains 16 ounces of carbonated drink. 


From the sample data, we can calculate a statistic. A statistic is a number 
that is a property of the sample. For example, if we consider one math class 
to be a sample of the population of all math classes, then the average 
number of points earned by students in that one math class at the end of the 
term is an example of a statistic. The statistic is an estimate of a population 
parameter. A parameter is a number that is a property of the population. 
Since we considered all math classes to be the population, then the average 
number of points earned per student over all the math classes is an example 
of a parameter. 


One of the main concerns in the field of statistics is how accurately a 
Statistic estimates a parameter. The accuracy really depends on how well the 
sample represents the population. The sample must contain the 
characteristics of the population in order to be a representative sample. We 
are interested in both the sample statistic and the population parameter in 
inferential statistics. In a later chapter, we will use the sample statistic to 
test the validity of the established population parameter. 


A variable, notated by capital letters like X and Y, is a characteristic of 
interest for each person or thing in a population. Variables may be 
numerical or categorical. Numerical variables take on values with equal 
units such as weight in pounds and time in hours. Categorical variables 
place the person or thing into a category. If we let X equal the number of 
points earned by one math student at the end of a term, then X isa 
numerical variable. If we let Y be a person's party affiliation, then examples 
of Y include Republican, Democrat, and Independent. Y is a categorical 
variable. We could do some math with values of X (calculate the average 
number of points earned, for example), but it makes no sense to do math 
with values of Y (calculating an average party affiliation makes no sense). 


Data are the actual values of the variable. They may be numbers or they 
may be words. Datum is a single value. 


Two words that come up often in statistics are mean and proportion. If you 
were to take three exams in your math classes and obtained scores of 86, 
75, and 92, you calculate your mean score by adding the three exam scores 
and dividing by three (your mean score would be 84.3 to one decimal 
place). If, in your math class, there are 40 students and 22 are men and 18 


are women, then the proportion of men students is a. and the proportion of 


women students is 3 Mean and proportion are discussed in more detail in 


later chapters. 


Note: 

Mean and Average 

The words "mean" and "average" are often used interchangeably. The 
substitution of one word for the other is common practice. The technical 
term is "arithmetic mean" and "average" is technically a center location. 
However, in practice among non-statisticians, "average" is commonly 
accepted for "arithmetic mean." 


Example: 


Exercise: 


Problem: 


Define the key terms from the following study: We want to know the 
average (mean) amount of money first year college students spend at 
ABC College on school supplies that do not include books. We 
randomly survey 100 first year students at the college. Three of those 
students spent $150, $200, and $225, respectively. 


Solution: 


The population is all first year students attending ABC College this 
term. 


The sample could be all students enrolled in one section of a 
beginning statistics course at ABC College (although this sample may 
not represent the entire population). 


The parameter is the average (mean) amount of money spent 
(excluding books) by first year college students at ABC College this 
term. 


The statistic is the average (mean) amount of money spent (excluding 
books) by first year college students in the sample. 


The variable could be the amount of money spent (excluding books) 
by one first year student. Let X = the amount of money spent 
(excluding books) by one first year student attending ABC College. 


The data are the dollar amounts spent by the first year students. 
Examples of the data are $150, $200, and $225. 


Optional Collaborative Classroom Exercise 


Do the following exercise collaboratively with up to four people per group. 
Find a population, a sample, the parameter, the statistic, a variable, and data 
for the following study: You want to determine the average (mean) number 
of glasses of milk college students drink per day. Suppose yesterday, in your 
English class, you asked five students how many glasses of milk they drank 
the day before. The answers were 1, 0, 1, 3, and 4 glasses of milk. 


Glossary 


Average 
A number that describes the central tendency of the data. There are a 
number of specialized averages, including the arithmetic mean, 
weighted mean, median, mode, and geometric mean. 


Data 
A set of observations (a set of possible outcomes). Most data can be 
put into two groups: qualitative (hair color, ethnic groups and other 
attributes of the population) and quantitative (distance traveled to 
college, number of children in a family, etc.). Quantitative data can be 
separated into two subgroups: discrete and continuous. Data is 
discrete if it is the result of counting (the number of students of a given 
ethnic group in a class, the number of books on a shelf, etc.). Data is 
continuous if it is the result of measuring (distance traveled, weight of 
luggage, etc.) 


Proportion 


e Asa number: A proportion is the number of successes divided by 
the total number in the sample. 

e Asa probability distribution: Given a binomial random variable 
(RV), X ~B(n, p), consider the ratio of the number X of 
successes in n Bernouli trials to the number n of trials. P/= ~. 
This new RV is called a proportion, and if the number of trials, n, 
is large enough, P’ ~N(p, ®*). 


Data 

This module introduces the concepts of qualitative data, quantitative 
continuous data, and quantitative discrete data as used in statistics. Sample 
problems are included. 


Data may come from a population or from a sample. Small letters like x or 
y generally are used to represent data values. Most data can be put into the 
following categories: 


e¢ Qualitative 
¢ Quantitative 


Qualitative data are the result of categorizing or describing attributes of a 
population. Hair color, blood type, ethnic group, the car a person drives, and 
the street a person lives on are examples of qualitative data. Qualitative data 
are generally described by words or letters. For instance, hair color might 
be black, dark brown, light brown, blonde, gray, or red. Blood type might 
be AB+, O-, or B+. Researchers often prefer to use quantitative data over 
qualitative data because it lends itself more easily to mathematical analysis. 
For example, it does not make sense to find an average hair color or blood 


type. 


Quantitative data are always numbers. Quantitative data are the result of 
counting or measuring attributes of a population. Amount of money, pulse 
rate, weight, number of people living in your town, and the number of 
students who take statistics are examples of quantitative data. Quantitative 
data may be either discrete or continuous. 


All data that are the result of counting are called quantitative discrete 
data. These data take on only certain numerical values. If you count the 
number of phone calls you receive for each day of the week, you might get 
0, 1, 2, 3, etc. 


All data that are the result of measuring are quantitative continuous data 
assuming that we can measure accurately. Measuring angles in radians 
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might result in the numbers etc. If you and your friends 


backpacks are discrete data and the weights of the backpacks are continuous 
data. 


Note:In this course, the data used is mainly quantitative. It is easy to 
calculate statistics (like the mean or proportion) from numbers. In the 
chapter Descriptive Statistics, you will be introduced to stem plots, 
histograms and box plots all of which display quantitative data. Qualitative 
data is discussed at the end of this section through graphs. 


Example: 

Data Sample of Quantitative Discrete Data 

The data are the number of books students carry in their backpacks. You 
sample five students. Two students carry 3 books, one student carries 4 
books, one student carries 2 books, and one student carries 1 book. The 
numbers of books (3, 4, 2, and 1) are the quantitative discrete data. 


Example: 

Data Sample of Quantitative Continuous Data 

The data are the weights of the backpacks with the books in it. You sample 
the same five students. The weights (in pounds) of their backpacks are 6.2, 
7, 6.8, 9.1, 4.3. Notice that backpacks carrying three books can have 
different weights. Weights are quantitative continuous data because 
weights are measured. 


Example: 

Data Sample of Qualitative Data 

The data are the colors of backpacks. Again, you sample the same five 
students. One student has a red backpack, two students have black 
backpacks, one student has a green backpack, and one student has a gray 
backpack. The colors red, black, black, green, and gray are qualitative data. 


Note: You may collect data as numbers and report it categorically. For 
example, the quiz scores for each student are recorded throughout the term. 
At the end of the term, the quiz scores are reported as A, B, C, D, or F. 


Example: 
Exercise: 


Problem: 


Work collaboratively to determine the correct data type (quantitative 
or qualitative). Indicate whether quantitative data are continuous or 
discrete. Hint: Data that are discrete often start with the words "the 
number of." 


I 
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. The number of pairs of shoes you own. 

. The type of car you drive. 

. Where you go on vacation. 

. The distance it is from your home to the nearest grocery store. 


The number of classes you take per school year. 


. The tuition for your classes 


The type of calculator you use. 


. Movie ratings. 

. Political party preferences. 

. Weight of sumo wrestlers. 

. Amount of money won playing poker. 

. Number of correct answers on a quiz. 

. Peoples’ attitudes toward the government. 

. IQ scores. (This may cause some discussion. ) 


Solution: 


Items 1, 5, 11, and 12 are quantitative discrete; items 4, 6, 10, and 14 
are quantitative continuous; and items 2, 3, 7, 8, 9, and 13 are 
qualitative. 


Qualitative Data Discussion 

Below are tables of part-time vs full-time students at De Anza College in 
Cupertino, CA and Foothill College in Los Altos, CA for the Spring 2010 
quarter. The tables display counts (frequencies) and percentages or 
proportions (relative frequencies). The percent columns make comparing 
the same categories in the colleges easier. Displaying percentages along 
with the numbers is often helpful, but it is particularly important when 
comparing sets of data that do not have the same totals, such as the total 
enrollments for both colleges in this example. Notice how much larger the 
percentage for part-time students at Foothill College is compared to De 
Anza College. 


Number Percent 
Full-time 9,200 40.9% 
Part-time 13,296 59.1% 
Total 22,496 100% 
De Anza College 
Number Percent 
Full-time 4,059 28.6% 


Part-time 10,124 71.4% 


Total 14,183 100% 
Foothill College 


Tables are a good way of organizing and displaying data. But graphs can be 
even more helpful in understanding the data. There are no strict rules 
concerning what graphs to use. Below are pie charts and bar graphs, two 
graphs that are used to display qualitative data. 


In a pie chart, categories of data are represented by wedges in the circle 
and are proportional in size to the percent of individuals in each category. 


In a bar graph, the length of the bar for each category is proportional to the 
number or percent of individuals in each category. Bars may be vertical or 
horizontal. 


A Pareto chart consists of bars that are sorted into order by category size 
(largest to smallest). 


Look at the graphs and determine which graph (pie or bar) you think 
displays the comparisons better. This is a matter of preference. 


It is a good idea to look at a variety of graphs to see which is the most 
helpful in displaying the data. We might make different choices of what we 
think is the "best" graph depending on the data and the context. Our choice 
also depends on what we are using the data for. 


De Anza College 


@ Full Time o Part Time 


Student Status 
Pat Tire Pat Time 


Pert Tire 


De Anza Foothill 


Foothill College 


@ Full Time & Part Time 


Full Time 
28.6% 


Part Time 
71.4% 


Percentages That Add to More (or Less) Than 100% 

Sometimes percentages add up to be more than 100% (or less than 100%). 
In the graph, the percentages add to more than 100% because students can 
be in more than one category. A bar graph is appropriate to compare the 
relative size of the categories. A pie chart cannot be used. It also could not 
be used if the percentages added to less than 100%. 


Characteristic/Category Percent 


Full-time Students 40.9% 
Students who intend to transfer to a 4-year educational 48.6% 
institution 

Students under age 25 61.0% 
TOTAL 150.5% 


De Anza College Spring 2010 


Omitting Categories/Missing Data 

The table displays Ethnicity of Students but is missing the 
"Other/Unknown" category. This category contains people who did not feel 
they fit into any of the ethnicity categories or declined to respond. Notice 
that the frequencies do not add up to the total number of students. Create a 
bar graph and not a pie chart. 


Frequency Percent 


Asian 8,794 36.1% 

Black 1,412 5.8% 

Filipino 1,298 5.3% 

Hispanic 4,180 17.1% 

Native American 146 0.6% 

Pacific Islander 236 1.0% 

White 5,978 24.5% 

TOTAL 22,044 out of 24,382 90.4% out of 100% 


Missing Data: Ethnicity of Students De Anza College Fall Term 2007 
(Census Day) 


E thnicity of Students 


40.0% 


35.0% 
20.0% 
25.0% 
20.0% 
15.0% 
10.0% 

5.0% 


°* Asian Black Filipino Hispanic Native Pacific White 
Amer. Islander 
36.1% 58% 53% 17.1% 06% 1.0% 


Bar graph Without Other/Unknown Category 


The following graph is the same as the previous graph but the 
"Other/Unknown" percent (9.6%) has been added back in. The 
"Other/Unknown" category is large compared to some of the other 
categories (Native American, 0.6%, Pacific Islander 1.0% particularly). 
This is important to know when we think about what the data are telling us. 


This particular bar graph can be hard to understand visually. The graph 
below it is a Pareto chart. The Pareto chart has the bars sorted from largest 
to smallest and is easier to read and interpret. 


Ethnicity of Students 


Bar Graph With Other/Unknown Category 


Pareto Chart With Bars Sorted By Size 


Pie Charts: No Missing Data 

The following pie charts have the "Other/Unknown" category added back in 
(since the percentages must add to 100%). The chart on the right is 
organized having the wedges by size and makes for a more visually 
informative graph than the unsorted, alphabetical graph on the left. 


Ethnicity of Students Ethnicity of Students 


Pacific Islander 


Glossary 


Continuous Random Variable 
A random variable (RV) whose outcomes are measured. 


Example: 
The height of trees in the forest is a continuous RV. 


Data 
A set of observations (a set of possible outcomes). Most data can be 
put into two groups: qualitative (hair color, ethnic groups and other 
attributes of the population) and quantitative (distance traveled to 
college, number of children in a family, etc.). Quantitative data can be 
separated into two subgroups: discrete and continuous. Data is 
discrete if it is the result of counting (the number of students of a given 
ethnic group in a class, the number of books on a shelf, etc.). Data is 
continuous if it is the result of measuring (distance traveled, weight of 
luggage, etc.) 


Discrete Random Variable 
A random variable (RV) whose outcomes are counted. 


Qualitative Data 
See Data. 


Quantitative Data 
See Data. 


Sampling 

This module introduces the concept of statistical sampling. Students are 
taught the difference between a simple random sample, stratified sample, 
cluster sample, systematic sample, and convenience sample. Example 
problems are provided, including an optional classroom activity. 


Gathering information about an entire population often costs too much or is 
virtually impossible. Instead, we use a sample of the population. A sample 
should have the same characteristics as the population it is 
representing. Most statisticians use various methods of random sampling 
in an attempt to achieve this goal. This section will describe a few of the 
most common methods. 


There are several different methods of random sampling. In each form of 
random sampling, each member of a population initially has an equal 
chance of being selected for the sample. Each method has pros and cons. 
The easiest method to describe is called a simple random sample. Any 
group of n individuals is equally likely to be chosen by any other group of n 
individuals if the simple random sampling technique is used. In other 
words, each sample of the same size has an equal chance of being selected. 
For example, suppose Lisa wants to form a four-person study group (herself 
and three other people) from her pre-calculus class, which has 31 members 
not including Lisa. To choose a simple random sample of size 3 from the 
other members of her class, Lisa could put all 31 names in a hat, shake the 
hat, close her eyes, and pick out 3 names. A more technological way is for 
Lisa to first list the last names of the members of her class together with a 
two-digit number as shown below. 


ID Name 


00 Anselmo 


ID 


01 


02 


03 


04 


05 


06 


07 


08 


09 


10 


11 


12 


13 


14 


15 


16 


17 


Name 
Bautista 
Bayani 
Cheng 
Cuarismo 
Cuningham 
Fontecha 
Hong 
Hoobler 
Jiao 

Khan 
King 
Legeny 
Lundquist 
Macierz 
Motogawa 
Okimoto 


Patel 


ID 


18 


19 


20 


21 


22 


23 


24 


25 


26 


27. 


28 


29 


30 


Class Roster 


Name 
Price 
Quizon 
Reyes 
Roquero 
Roth 
Rowell 
Salangsang 
Slade 
Stracher 
Tallai 
Tran 
Wai 


Wood 


Lisa can either use a table of random numbers (found in many statistics 
books as well as mathematical handbooks) or a calculator or computer to 
generate random numbers. For this example, suppose Lisa chooses to 
generate random numbers from a calculator. The numbers generated are: 


94360 .99832 .14669 .51470 .40581 .73381 .04399 


Lisa reads two-digit groups until she has chosen three class members (that 
is, she reads .94360 as the groups 94, 43, 36, 60). Each random number 
may only contribute one class member. If she needed to, Lisa could have 
generated more random numbers. 


The random numbers .94360 and .99832 do not contain appropriate two 
digit numbers. However the third random number, .14669, contains 14 (the 
fourth random number also contains 14), the fifth random number contains 
05, and the seventh random number contains 04. The two-digit number 14 
corresponds to Macierz, 05 corresponds to Cunningham, and 04 
corresponds to Cuarismo. Besides herself, Lisa's group will consist of 
Marcierz, and Cunningham, and Cuarismo. 


Besides simple random sampling, there are other forms of sampling that 
involve a chance process for getting the sample. Other well-known 
random sampling methods are the stratified sample, the cluster sample, 
and the systematic sample. 


To choose a stratified sample, divide the population into groups called 
strata and then take a proportionate number from each stratum. For 
example, you could stratify (group) your college population by department 
and then choose a proportionate simple random sample from each stratum 
(each department) to get a stratified random sample. To choose a simple 
random sample from each department, number each member of the first 
department, number each member of the second department and do the 
same for the remaining departments. Then use simple random sampling to 
choose proportionate numbers from the first department and do the same for 
each of the remaining departments. Those numbers picked from the first 
department, picked from the second department and so on represent the 
members who make up the stratified sample. 


To choose a cluster sample, divide the population into clusters (groups) 
and then randomly select some of the clusters. All the members from these 
clusters are in the cluster sample. For example, if you randomly sample four 
departments from your college population, the four departments make up 
the cluster sample. For example, divide your college faculty by department. 
The departments are the clusters. Number each department and then choose 


four different numbers using simple random sampling. All members of the 
four departments with those numbers are the cluster sample. 


To choose a systematic sample, randomly select a starting point and take 
every nth piece of data from a listing of the population. For example, 
suppose you have to do a phone survey. Your phone book contains 20,000 
residence listings. You must choose 400 names for the sample. Number the 
population 1 - 20,000 and then use a simple random sample to pick a 
number that represents the first name of the sample. Then choose every 
50th name thereafter until you have a total of 400 names (you might have to 
go back to the of your phone list). Systematic sampling is frequently chosen 
because it is a simple method. 


A type of sampling that is nonrandom is convenience sampling. 
Convenience sampling involves using results that are readily available. For 
example, a computer software store conducts a marketing study by 
interviewing potential customers who happen to be in the store browsing 
through the available software. The results of convenience sampling may be 
very good in some cases and highly biased (favors certain outcomes) in 
others. 


Sampling data should be done very carefully. Collecting data carelessly can 
have devastating results. Surveys mailed to households and then returned 
may be very biased (for example, they may favor a certain group). It is 
better for the person conducting the survey to select the sample 
respondents. 


True random sampling is done with replacement. That is, once a member 
is picked that member goes back into the population and thus may be 
chosen more than once. However for practical reasons, in most populations, 
simple random sampling is done without replacement. Surveys are 
typically done without replacement. That is, a member of the population 
may be chosen only once. Most samples are taken from large populations 
and the sample tends to be small in comparison to the population. Since this 
is the case, sampling without replacement is approximately the same as 
sampling with replacement because the chance of picking the same 
individual more than once using with replacement is very low. 


For example, in a college population of 10,000 people, suppose you want to 
randomly pick a sample of 1000 for a survey. For any particular sample 
of 1000, if you are sampling with replacement, 


e the chance of picking the first person is 1000 out of 10,000 (0.1000); 

e the chance of picking a different second person for this sample is 999 
out of 10,000 (0.0999); 

e the chance of picking the same person again is 1 out of 10,000 (very 
low). 


If you are sampling without replacement, 


e the chance of picking the first person for any particular sample is 1000 
out of 10,000 (0.1000); 

e the chance of picking a different second person is 999 out of 9,999 
(0.0999); 

e you do not replace the first person before picking the next person. 


Compare the fractions 999/10,000 and 999/9,999. For accuracy, carry the 
decimal answers to 4 place decimals. To 4 decimal places, these numbers 
are equivalent (0.0999). 


Sampling without replacement instead of sampling with replacement only 
becomes a mathematics issue when the population is small which is not that 
common. For example, if the population is 25 people, the sample is 10 and 
you are sampling with replacement for any particular sample, 


e the chance of picking the first person is 10 out of 25 and a different 
second person is 9 out of 25 (you replace the first person). 


If you sample without replacement, 


e the chance of picking the first person is 10 out of 25 and then the 
second person (which is different) is 9 out of 24 (you do not replace 
the first person). 


Compare the fractions 9/25 and 9/24. To 4 decimal places, 9/25 = 0.3600 
and 9/24 = 0.3750. To 4 decimal places, these numbers are not equivalent. 


When you analyze data, it is important to be aware of sampling errors and 
nonsampling errors. The actual process of sampling causes sampling errors. 
For example, the sample may not be large enough. Factors not related to the 
sampling process cause nonsampling errors. A defective counting device 
can cause a nonsampling error. 


In reality, a sample will never be exactly representative of the population so 
there will always be some sampling error. As a rule, the larger the sample, 
the smaller the sampling error. 


In statistics, a sampling bias is created when a sample is collected from a 
population and some members of the population are not as likely to be 
chosen as others (remember, each member of the population should have an 
equally likely chance of being chosen). When a sampling bias happens, 
there can be incorrect conclusions drawn about the population that is being 
studied. 


Example: 
Exercise: 


Problem: 


Determine the type of sampling used (simple random, stratified, 
systematic, cluster, or convenience). 


1. A soccer coach selects 6 players from a group of boys aged 8 to 
10, 7 players from a group of boys aged 11 to 12, and 3 players 
from a group of boys aged 13 to 14 to form a recreational soccer 
team. 

2. A pollster interviews all human resource personnel in five 
different high tech companies. 

3. A high school educational researcher interviews 50 high school 
female teachers and 50 high school male teachers. 

4. A medical researcher interviews every third cancer patient from 
a list of cancer patients at a local hospital. 


5. A high school counselor uses a computer to generate 50 random 
numbers and then picks students whose names correspond to the 
numbers. 

6. A student interviews classmates in his algebra class to determine 
how many pairs of jeans a student owns, on the average. 


Solution: 


. stratified 

. cluster 

. stratified 

. systematic 

. simple random 
. convenience 


AuBWN PRP 


If we were to examine two samples representing the same population, even 
if we used random sampling methods for the samples, they would not be 
exactly the same. Just as there is variation in data, there is variation in 
samples. As you become accustomed to sampling, the variability will seem 
natural. 


Example: 

Suppose ABC College has 10,000 part-time students (the population). We 
are interested in the average amount of money a part-time student spends 
on books in the fall term. Asking all 10,000 students is an almost 
impossible task. 

Suppose we take two different samples. 

First, we use convenience sampling and survey 10 students from a first 
term organic chemistry class. Many of these students are taking first term 
calculus in addition to the organic chemistry class . The amount of money 
they spend is as follows: 

$128 $87 $173 $116 $130 $204 $147 $189 $93 $153 


The second sample is taken by using a list from the P.E. department of 
senior citizens who take P.E. classes and taking every 5th senior citizen on 
the list, for a total of 10 senior citizens. They spend: 

$50 $40 $36 $15 $50 $100 $40 $53 $22 $22 

Exercise: 


Problem: 


Do you think that either of these samples is representative of (or is 
characteristic of) the entire 10,000 part-time student population? 


Solution: 


No. The first sample probably consists of science-oriented students. 
Besides the chemistry course, some of them are taking first-term 
calculus. Books for these classes tend to be expensive. Most of these 
students are, more than likely, paying more than the average part-time 
student for their books. The second sample is a group of senior 
citizens who are, more than likely, taking courses for health and 
interest. The amount of money they spend on books is probably much 
less than the average part-time student. Both samples are biased. Also, 
in both cases, not all students have a chance to be in either sample. 


Exercise: 
Problem: 


Since these samples are not representative of the entire population, is 
it wise to use the results to describe the entire population? 


Solution: 


No. For these samples, each member of the population did not have an 
equally likely chance of being chosen. 


Now, suppose we take a third sample. We choose ten different part-time 
students from the disciplines of chemistry, math, English, psychology, 
sociology, history, nursing, physical education, art, and early childhood 
development. (We assume that these are the only disciplines in which part- 
time students at ABC College are enrolled and that an equal number of 


part-time students are enrolled in each of the disciplines.) Each student is 
chosen using simple random sampling. Using a calculator, random 
numbers are generated and a student from a particular discipline is selected 
if he/she has a corresponding number. The students spend: 

$180 $50 $150 $85 $260 $75 $180 $200 $200 $150 

Exercise: 


Problem: Is the sample biased? 
Solution: 


The sample is unbiased, but a larger sample would be recommended 
to increase the likelihood that the sample will be close to 
representative of the population. However, for a biased sampling 
technique, even a large sample runs the risk of not being 
representative of the population. 


Students often ask if it is "good enough" to take a sample, instead of 
surveying the entire population. If the survey is done well, the answer is 
yes. 


Optional Collaborative Classroom Exercise 


Exercise: 


Problem: 


As a class, determine whether or not the following samples are 
representative. If they are not, discuss the reasons. 


1. To find the average GPA of all students in a university, use all 
honor students at the university as the sample. 

2. To find out the most popular cereal among young people under 
the age of 10, stand outside a large supermarket for three hours 
and speak to every 20th child under age 10 who enters the 
supermarket. 


3. To find the average annual income of all adults in the United 
States, sample U.S. congressmen. Create a cluster sample by 
considering each state as a stratum (group). By using simple 
random sampling, select states to be part of the cluster. Then 
survey every U.S. congressman in the cluster. 

4. To determine the proportion of people taking public transportation 
to work, survey 20 people in New York City. Conduct the survey 
by sitting in Central Park on a bench and interviewing every 
person who sits next to you. 

5. To determine the average cost of a two day stay in a hospital in 
Massachusetts, survey 100 hospitals across the state using simple 
random sampling. 


Variation 

This module discusses statistical variability within data and samples. 
Students will be given the opportunity to see this variability in action 
through participation in an optional classroom exercise. This module also 
has a section that discusses Critical Evaluation. 


Variation in Data 


Variation is present in any set of data. For example, 16-ounce cans of 
beverage may contain more or less than 16 ounces of liquid. In one study, 
eight 16 ounce cans were measured and produced the following amount (in 
ounces) of beverage: 


15.6.16.1 15.2 14.8 15.8 15.9 16.0 15.5 


Measurements of the amount of beverage in a 16-ounce can may vary 
because different people make the measurements or because the exact 
amount, 16 ounces of liquid, was not put into the cans. Manufacturers 
regularly run tests to determine if the amount of beverage in a 16-ounce can 
falls within the desired range. 


Be aware that as you take data, your data may vary somewhat from the data 
someone else is taking for the same purpose. This is completely natural. 
However, if two or more of you are taking the same data and get very 
different results, it is time for you and the others to reevaluate your data- 
taking methods and your accuracy. 


Variation in Samples 


It was mentioned previously that two or more samples from the same 
population, taken randomly, and having close to the same characteristics of 
the population are different from each other. Suppose Doreen and Jung both 
decide to study the average amount of time students at their college sleep 
each night. Doreen and Jung each take samples of 500 students. Doreen 
uses systematic sampling and Jung uses cluster sampling. Doreen's sample 
will be different from Jung's sample. Even if Doreen and Jung used the 


same sampling method, in all likelihood their samples would be different. 
Neither would be wrong, however. 


Think about what contributes to making Doreen's and Jung's samples 
different. 


If Doreen and Jung took larger samples (i.e. the number of data values is 
increased), their sample results (the average amount of time a student 
Sleeps) might be closer to the actual population average. But still, their 
samples would be, in all likelihood, different from each other. This 
variability in samples cannot be stressed enough. 


Size of a Sample 


The size of a sample (often called the number of observations) is important. 
The examples you have seen in this book so far have been small. Samples 
of only a few hundred observations, or even smaller, are sufficient for many 
purposes. In polling, samples that are from 1200 to 1500 observations are 
considered large enough and good enough if the survey is random and is 
well done. You will learn why when you study confidence intervals. 


Be aware that many large samples are biased. For example, call-in surveys 
are invariable biased because people choose to respond or not. 


Optional Collaborative Classroom Exercise 


Exercise: 


Problem: 


Divide into groups of two, three, or four. Your instructor will give each 
group one 6-sided die. Try this experiment twice. Roll one fair die (6- 
sided) 20 times. Record the number of ones, twos, threes, fours, fives, 
and sixes you get below ("frequency" is the number of times a 
particular face of the die occurs): 


Face on Die Frequency 


i) 


rs) 
6 


First Experiment (20 rolls) 


Face on Die Frequency 


i. 


rs) 
6 


Second Experiment (20 rolls) 


Did the two experiments have the same results? Probably not. If you 
did the experiment a third time, do you expect the results to be 
identical to the first or second experiment? (Answer yes or no.) Why 
or why not? 


Which experiment had the correct results? They both did. The job of 
the statistician is to see through the variability and draw appropriate 
conclusions. 


Critical Evaluation 


We need to critically evaluate the statistical studies we read about and 
analyze before accepting the results of the study. Common problems to be 
aware of include 


e Problems with Samples: A sample should be representative of the 
population. A sample that is not representative of the population is 
biased. Biased samples that are not representative of the population 
give results that are inaccurate and not valid. 

e Self-Selected Samples: Responses only by people who choose to 
respond, such as call-in surveys are often unreliable. 

e Sample Size Issues: Samples that are too small may be unreliable. 
Larger samples are better if possible. In some situations, small samples 
are unavoidable and can still be used to draw conclusions, even though 
larger samples are better. Examples: Crash testing cars, medical testing 
for rare conditions. 

e Undue influence: Collecting data or asking questions in a way that 
influences the response. 

e Non-response or refusal of subject to participate: The collected 
responses may no longer be representative of the population. Often, 
people with strong positive or negative opinions may answer surveys, 
which can affect the results. 

e Causality: A relationship between two variables does not mean that 
one causes the other to occur. They may both be related (correlated) 
because of their relationship through a different variable. 

e Self-Funded or Self-Interest Studies: A study performed by a person or 
organization in order to support their claim. Is the study impartial? 


Read the study carefully to evaluate the work. Do not automatically 
assume that the study is good but do not automatically assume the 
study is bad either. Evaluate it on its merits and the work done. 

e Misleading Use of Data: Improperly displayed graphs, incomplete 
data, lack of context. 

e Confounding: When the effects of multiple factors on a response 
cannot be separated. Confounding makes it difficult or impossible to 
draw valid conclusions about the effect of each factor. 


Glossary 


Population 
The collection, or set, of all individuals, objects, or measurements 
whose properties are being studied. 


Sample 
A portion of the population understudy. A sample is representative if it 
characterizes the population being studied. 


Answers and Rounding Off 
This module briefly explains the correct way to round off answers when 
working with statistical data. 


A simple way to round off answers is to carry your final answer one more 
decimal place than was present in the original data. Round only the final 
answer. Do not round any intermediate results, if possible. If it becomes 
necessary to round intermediate results, carry them to at least twice as many 
decimal places as the final answer. For example, the average of the three 
quiz scores 4, 6, 9 is 6.3, rounded to the nearest tenth, because the data are 
whole numbers. Most answers will be rounded in this manner. 


It is not necessary to reduce most fractions in this course. Especially in 
Probability Topics, the chapter on probability, it is more helpful to leave an 
answer as an unreduced fraction. 


Frequency 

This module introduces the concepts of frequency, relative frequency, and 
cumulative relative frequency, and the relationship between these measures. 
Students will have the opportunity to interpret data through the sample problems 
provided. 


Twenty students were asked how many hours they worked per day. Their 
responses, in hours, are listed below: 


96332475235654435253 


Below is a frequency table listing the different data values in ascending order and 
their frequencies. 


DATA VALUE FREQUENCY 
2 3 
3 fs) 
4 3 
fs) 6 
6 2 
7 1 


Frequency Table of Student Work Hours 


A frequency is the number of times a given datum occurs in a data set. 
According to the table above, there are three students who work 2 hours, five 
students who work 3 hours, etc. The total of the frequency column, 20, represents 
the total number of students included in the sample. 


A relative frequency is the fraction or proportion of times an answer occurs. To 
find the relative frequencies, divide each frequency by the total number of 
students in the sample - in this case, 20. Relative frequencies can be written as 
fractions, percents, or decimals. 


DATA VALUE FREQUENCY RELATIVE FREQUENCY 


2 3 +. or 0.15 
3 5 2 or 0.25 
A 3 x or 0.15 
5 6 3; or 0.30 
6 2 + or 0.10 
7 1 $a or 0.05 


Frequency Table of Student Work Hours w/ Relative Frequency 


The sum of the relative frequency column is an or 1. 


Cumulative relative frequency is the accumulation of the previous relative 
frequencies. To find the cumulative relative frequencies, add all the previous 
relative frequencies to the relative frequency for the current row. 


CUMULATIVE 


DATA RELATIVE RELATIVE 
VALUE FREQUENCY FREQUENCY FREQUENCY 
2 3 3 or 0.15 0.15 

5 0.15 + 0.25 = 
3 i) 59 OF 0.25 0.40 

as 0.40 + 0.15 = 
4 3 50 OF 0.15 0.55 

6 0.55 + 0.30 = 
5 6 59 OF 0.30 0.85 

2 0.85 + 0.10 = 
6 2 30 OF 0.10 0.95 

ot) 0.95 + 0.05 = 
7 1 59 OF 0.05 1.00 


Frequency Table of Student Work Hours w/ Relative and Cumulative Relative 
Frequency 


The last entry of the cumulative relative frequency column is one, indicating that 
one hundred percent of the data has been accumulated. 


Note:Because of rounding, the relative frequency column may not always sum 
to one and the last entry in the cumulative relative frequency column may not be 
one. However, they each should be close to one. 


The following table represents the heights, in inches, of a sample of 100 male 
semiprofessional soccer players. 


HEIGHTS 
(INCHES) 


59.95 - 
61.95 


61.95 - 
63.95 


63.95 - 
65.95 


65.95 - 
67.95 


67.95 - 
69.95 


69.95 - 
71.95 


71.95 - 
7390 


73.95 - 
75.95 


FREQUENCY 


15 


40 


17 


12 


Total = 100 


59.95 - 61.95 inches 
61.95 - 63.95 inches 
63.95 - 65.95 inches 
65.95 - 67.95 inches 
67.95 - 69.95 inches 


RELATIVE 
FREQUENCY 
<a5 = 0.05 

=35 = 0.03 

G60 = 0-15 

2. = 0.40 

ay = 0.17 

Fay = 0.12 

aie = 0.07 

500 = 0.01 
Total = 1.00 


Frequency Table of Soccer Player Height 


CUMULATIVE 
RELATIVE 
FREQUENCY 


0.05 


0.05 + 0.03 = 
0.08 


0.08 + 0.15 = 
0.23 


0.23 + 0.40 = 
0.63 


0.63 + 0.17 = 
0.80 


0.80 + 0.12 = 
0.92 


0.92 + 0.07 = 
0.99 


0.99 + 0.01 = 
1.00 


The data in this table has been grouped into the following intervals: 


e 69.95 - 71.95 inches 
e 71.95 - 73.95 inches 
e 73.95 - 75.95 inches 


Note: This example is used again in the Descriptive Statistics chapter, where the 
method used to compute the intervals will be explained. 


In this sample, there are 5 players whose heights are between 59.95 - 61.95 
inches, 3 players whose heights fall within the interval 61.95 - 63.95 inches, 15 
players whose heights fall within the interval 63.95 - 65.95 inches, 40 players 
whose heights fall within the interval 65.95 - 67.95 inches, 17 players whose 
heights fall within the interval 67.95 - 69.95 inches, 12 players whose heights fall 
within the interval 69.95 - 71.95, 7 players whose height falls within the interval 
71.95 - 73.95, and 1 player whose height falls within the interval 73.95 - 75.95. 
All heights fall between the endpoints of an interval and not at the endpoints. 


Example: 
Exercise: 


Problem: 


From the table, find the percentage of heights that are less than 65.95 
inches. 


Solution: 


If you look at the first, second, and third rows, the heights are all less than 
65.95 inches. There are 5 + 3 + 15 = 23 males whose heights are less than 
65.95 inches. The percentage of heights less than 65.95 inches is then aan 
or 23%. This percentage is the cumulative relative frequency entry in the 


third row. 


Example: 


Exercise: 


Problem: 


From the table, find the percentage of heights that fall between 61.95 and 
65.95 inches. 


Solution: 


Add the relative frequencies in the second and third rows: 0.03 + 0.15 = 
0.18 or 18%. 


Example: 
Exercise: 


Problem: 


Use the table of heights of the 100 male semiprofessional soccer players. 
Fill in the blanks and check your answers. 


. The percentage of heights that are from 67.95 to 71.95 inches is: 

. The percentage of heights that are from 67.95 to 73.95 inches is: 

. The percentage of heights that are more than 65.95 inches is: 

. The number of players in the sample who are between 61.95 and 71.95 
inches tall is: 

5. What kind of data are the heights? 

6. Describe how you could gather this data (the heights) so that the data 

are characteristic of all male semiprofessional soccer players. 


BRWN Ee 


Remember, you count frequencies. To find the relative frequency, divide 
the frequency by the total number of data values. To find the cumulative 
relative frequency, add all of the previous relative frequencies to the 
relative frequency for the current row. 


Solution: 


led 76 
2. 36% 
Be 11 20 


4. 87 

5. quantitative continuous 

6. get rosters from each team and choose a simple random sample from 
each 


Optional Collaborative Classroom Exercise 


Exercise: 


Problem: 


In your class, have someone conduct a survey of the number of siblings 
(brothers and sisters) each student has. Create a frequency table. Add to it a 
relative frequency column and a cumulative relative frequency column. 
Answer the following questions: 


1. What percentage of the students in your class has 0 siblings? 
2. What percentage of the students has from 1 to 3 siblings? 
3. What percentage of the students has fewer than 3 siblings? 


Example: 

Nineteen people were asked how many miles, to the nearest mile they commute 
to work each day. The data are as follows: 

Is iene alerlsres0) vaalO list ays esuhowilerd Wise) 

The following table was produced: 


CUMULATIVE 
RELATIVE RELATIVE 
DATA FREQUENCY FREQUENCY FREQUENCY 


CUMULATIVE 
RELATIVE RELATIVE 
DATA FREQUENCY FREQUENCY FREQUENCY 


3 3 + 0.1579 
4 i in 0.2105 
5 3 4 0.1579 
7 2 4 0.2632 
10 3 = 0.4737 
12 2 A 0.7895 
13 1 ts 0.8421 
15 1 a 0.8948 
18 1 a. 0.9474 
20 1 de 1.0000 


Frequency of Commuting Distances 


Exercise: 


Problem: 


1. Is the table correct? If it is not correct, what is wrong? 

2. True or False: Three percent of the people surveyed commute 3 miles. 
If the statement is not correct, what should it be? If the table is 
incorrect, make the corrections. 

3. What fraction of the people surveyed commute 5 or 7 miles? 

4. What fraction of the people surveyed commute 12 miles or more? 
Less than 12 miles? Between 5 and 13 miles (does not include 5 and 
13 miles)? 


Solution: 


1. No. Frequency column sums to 18, not 19. Not all cumulative relative 
frequencies are correct. 

2. False. Frequency for 3 miles should be 1; for 2 miles (left out), 2. 
Cumulative relative frequency column should read: 0.1052, 0.1579, 
0.2105, 0.3684, 0.4737, 0.6316, 0.7368, 0.7895, 0.8421, 0.9474, 1. 
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Glossary 
Frequency 


The number of times a value of the data occurs. 


Relative Frequency 


The ratio of the number of times a value of the data occurs in the set of all 
outcomes to the number of all outcomes. 


Cumulative Relative Frequency 


The term applies to an ordered set of observations from smallest to largest. 
The Cumulative Relative Frequency is the sum of the relative frequencies 
for all values that are less than or equal to the given value. 


Summary 

This module provides an outline/review of key concepts related to statistical 
sampling and data. 

Statistics 


¢ Deals with the collection, analysis, interpretation, and presentation of 
data 


Probability 
e Mathematical tool used to study randomness 
Key Terms 


e Population 
e Parameter 
e Sample 

e Statistic 

e Variable 

e Data 


Types of Data 
¢ Quantitative Data (a number) 


o Discrete (You count it.) 
o Continuous (You measure it.) 


¢ Qualitative Data (a category, words) 
Sampling 
¢ With Replacement: A member of the population may be chosen more 
than once 
e Without Replacement: A member of the population may be chosen 


only once 


Random Sampling 


e Each member of the population has an equal chance of being selected 
Sampling Methods 
e Random 


Simple random sample 
Stratified sample 
Cluster sample 
Systematic sample 


oO 0 0 


e Not Random 
o Convenience sample 
Frequency (freq. or f) 
e The number of times an answer occurs 
Relative Frequency (rel. freq. or RF) 


e The proportion of times an answer occurs 
e Can be interpreted as a fraction, decimal, or percent 


Cumulative Relative Frequencies (cum. rel. freq. or cum RF) 


e An accumulation of the previous relative frequencies 


Practice: Sampling and Data 

This module provides an opportunity for students to practice concepts 
related to statistical sampling and data. Given a sample data set, the student 
will practice constructing frequency tables, differentiating between key 
terms, and comparing sampling techniques. 


Student Learning Outcomes 


e The student will construct frequency tables. 
e The student will differentiate between key terms. 
e The student will compare sampling techniques. 


Given 


Studies are often done by pharmaceutical companies to determine the 
effectiveness of a treatment program. Suppose that a new AIDS antibody 
drug is currently under study. It is given to patients once the AIDS 
symptoms have revealed themselves. Of interest is the average(mean) 
length of time in months patients live once starting the treatment. Two 
researchers each follow a different set of 40 AIDS patients from the start of 
treatment until their deaths. The following data (in months) are collected. 


Researcher A3 4 11 15 16 17 22 44 37 16 14 24 25 15 26 27 33 29 35 44 
13 21 22 10 12 8 40 32 26 27 31 34 29 17 8 24 18 47 33 34 


Researcher B3 14 115 16 17 28 41 31 18 14 14 26 25 21 22 31 2 35 44 23 
2121 16 12 18 41 22 16 25 33 34 29 13 18 24 23 42 33 29 


Organize the Data 


Complete the tables below using the data provided. 


Cumulative 
Survival Length Relative Relative 
(in months) Frequency Frequency Frequency 
0.5-6.5 
6.5-12.5 
12.5 - 18.5 
18.5 - 24.5 
24.5 - 30.5 
30.5 - 36.5 
36.5 - 42.5 


42.5 - 48.5 


Researcher A 


Cumulative 
Survival Length Relative Relative 
(in months) Frequency Frequency Frequency 
0.5-6.5 
6.5-12.5 


12.5 - 18.5 


Cumulative 

Survival Length Relative Relative 

(in months) Frequency Frequency Frequency 
18.5 - 24.5 

24.5 - 30.5 

30.5 - 36.5 

36.5 - 42.5 

42.5 - 48.5 


Researcher B 


Key Terms 


Define the key terms based upon the above example for Researcher A. 
Exercise: 


Problem: Population 


Exercise: 


Problem: Sample 


Exercise: 


Problem: Parameter 


Exercise: 


Problem: Statistic 


Exercise: 


Problem: Variable 


Exercise: 


Problem: Data 


Discussion Questions 


Discuss the following questions and then answer in complete sentences. 
Exercise: 


Problem: List two reasons why the data may differ. 
Exercise: 
Problem: 
Can you tell if one researcher is correct and the other one is incorrect? 
Why? 


Exercise: 


Problem: Would you expect the data to be identical? Why or why not? 


Exercise: 


Problem: How could the researchers gather random data? 
Exercise: 
Problem: 
Suppose that the first researcher conducted his survey by randomly 
choosing one state in the nation and then randomly picking 40 patients 


from that state. What sampling method would that researcher have 
used? 


Exercise: 


Problem: 


Suppose that the second researcher conducted his survey by choosing 
AO patients he knew. What sampling method would that researcher 
have used? What concerns would you have about this data set, based 
upon the data collection method? 


Sampling and Data Homework Link (Collaborative Statistics; R. Bloom 
custom version) 


Link to homework questions in Homework Collection/Book for Sampling 
and Data Chapter 1 of Collaborative Statistics for R. Bloom 


Descriptive Statistics 


Student Learning Outcomes 
By the end of this chapter, the student should be able to: 


e Display data graphically and interpret graphs: stemplots, histograms 
and boxplots. 

e Recognize, describe, and calculate the measures of location of data: 
quartiles and percentiles. 

e Recognize, describe, and calculate the measures of the center of data: 
mean, median, and mode. 

e Recognize, describe, and calculate the measures of the spread of data: 
variance, standard deviation, and range. 


Introduction 


Once you have collected data, what will you do with it? Data can be 
described and presented in many different formats. For example, suppose 
you are interested in buying a house in a particular area. You may have no 
clue about the house prices, so you might ask your real estate agent to give 
you a sample data set of prices. Looking at all the prices in the sample often 
is overwhelming. A better way might be to look at the median price and the 
variation of prices. The median and variation are just two ways that you 
will learn to describe data. Your agent might also provide you with a graph 
of the data. 


In this chapter, you will study numerical and graphical ways to describe and 
display your data. This area of statistics is called "Descriptive Statistics". 
You will learn to calculate, and even more importantly, to interpret these 
measurements and graphs. 


Displaying Data 
This module provides a brief introduction into the ways graphs and charts 
can be used to provide visual representations of data. 


A Statistical graph is a tool that helps you learn about the shape or 
distribution of a sample. The graph can be a more effective way of 
presenting data than a mass of numbers because we can see where data 
clusters and where there are only a few data values. Newspapers and the 
Internet use graphs to show trends and to enable readers to compare facts 
and figures quickly. 


Statisticians often graph data first to get a picture of the data. Then, more 
formal tools may be applied. 


Some of the types of graphs that are used to summarize and organize data 
are the dot plot, the bar chart, the histogram, the stem-and-leaf plot, the 
frequency polygon (a type of broken line graph), pie charts, and the 
boxplot. In this chapter, we will briefly look at stem-and-leaf plots, line 
graphs and bar graphs. Our emphasis will be on histograms and boxplots. 


Stem and Leaf Graphs (Stemplots) 
This module introduces the use of stem-and-leaf graphs (stemplots), line 
graphs and bar graphs for describing a set of data visually. 


One simple graph, the stem-and-leaf graph or stem plot, comes from the 
field of exploratory data analysis.It is a good choice when the data sets are 
small. To create the plot, divide each observation of data into a stem and a 
leaf. The leaf consists of a final significant digit. For example, 23 has stem 
2 and leaf 3. Four hundred thirty-two (432) has stem 43 and leaf 2. Five 
thousand four hundred thirty-two (5,432) has stem 543 and leaf 2. The 
decimal 9.3 has stem 9 and leaf 3. Write the stems in a vertical line from 
smallest the largest. Draw a vertical line to the right of the stems. Then 
write the leaves in increasing order next to their corresponding stem. 


Example: 

For Susan Dean's spring pre-calculus class, scores for the first exam were 
as follows (smallest to largest): 
334249495355556163676868696972737478808388888890929494949496 
100 


Stem Leaf 
3 3 

4 299 
5 355 


6 1378899 


Stem Leaf 


7 2348 

8 03888 

9 0244446 
10 0 


Stem-and-Leaf Diagram 


The stem plot shows that most scores fell in the 60s, 70s, 80s, and 90s. 
Eight out of the 31 scores or approximately 26% of the scores were in the 
90's or 100, a fairly high number of As. 


The stem plot is a quick way to graph and gives an exact picture of the data. 
You want to look for an overall pattern and any outliers. An outlier is an 
observation of data that does not fit the rest of the data. It is sometimes 
called an extreme value. When you graph an outlier, it will appear not to fit 
the pattern of the graph. Some outliers are due to mistakes (for example, 
writing down 50 instead of 500) while others may indicate that something 
unusual is happening. It takes some background information to explain 
outliers. In the example above, there were no outliers. 


Example: 

Create a stem plot using the data: 
1.11.52.32.52.73.23.33.33.53.84.0 4.24.54.54.74.85.55.66.56.712.3 
The data are the distance (in kilometers) from a home to the nearest 
supermarket. 

Exercise: 


Problem: 


1. Are there any values that might possibly be outliers? 
2. Do the data seem to have any concentration of values? 


Note:The leaves are to the right of the decimal. 


Solution: 


The value 12.3 may be an outlier. Values appear to concentrate at 3 
and 4 kilometers. 


Stem Leaf 

1 15 

Z Sew 

3 23 35.0 
4 025578 
5 56 

6 5! 

oy 


Stem Leaf 


11 


12 3 


Another type of graph that is useful for specific data values is a line graph. 
In the particular line graph shown in the example, the x-axis consists of 
data values and the y-axis consists of frequency points. The frequency 
points are connected. 


Example: 
In a survey, 40 mothers were asked how many times per week a teenager 


must be reminded to do his/her chores. The results are shown in the table 
and the line graph. 


Number of times teenager is reminded Frequency 
0 2 


1 fs) 


Number of times teenager is reminded Frequency 


2. 8 
2 14 
4 7 
5 4 
16 
14 
12 
10 
Frequency & 
6 
4 
2 
0 
0 1 2 3 4 5 6 
Number of Times Teenager is 
Reminded 


Bar graphs consist of bars that are separated from each other. The bars can 
be rectangles or they can be rectangular boxes and they can be vertical or 
horizontal. 


The bar graph shown in Example 4 has age groups represented on the x- 
axis and proportions on the y-axis. 


Example: 

By the end of 2011, in the United States, Facebook had over 146 million 
users. The table shows three age groups, the number of users in each age 
group and the proportion (%) of users in each age group. Source: 
http://www.kenburbary.com/2011/03/facebook-demographics-revisited- 
2011-statistics-2/ 


Age Number of Proportion (“%) of 
groups Facebook users Facebook users 
13-25 65,082,280 45% 
26 - 44 53,300,200 36% 
45 - 64 27,885,100 19% 
50 
Ages 45 


Proportion(%) 25 


Example: 

The columns in the table below contain the race/ethnicity of U.S. Public 
Schools: High School Class of 2011, percentages for the Advanced 
Placement Examinee Population for that class and percentages for the 
Overall Student Population. The 3-dimensional graph shows the 
Race/Ethnicity of U.S. Public Schools (qualitative data) on the x-axis and 
Advanced Placement Examinee Population percentages on the y-axis. 
(Source: http://www.collegeboard.com and Source: 
http://apreport.collegeboard.org/goals-and-findings/promoting-equity) 


Overall 

AP Examinee Student 
Race/Ethnicity Population Population 
1 = Asian, Asian 
American or Pacific 10.3% 5.7% 
Islander 
2= Black or African 9.0% 14.7% 
American 
3 = Hispanic or Latino 17.0% 17.6% 
4 = American Indian or x 5 
Alaska Native es ee 
5 = White 57.1% 59.2% 


6 = Not reported/other 6.0% 1.7% 


Ethnicity/Race vs. Percent of AP 
Examinees 


57.1 


17 
10.3 


Go to Outcomes of Education Figure 22 for an example of a bar graph that 
shows unemployment rates of persons 25 years and older for 2009. 


Note:This book contains instructions for constructing a histogram and a 
box plot for the TI-83+ and TI-84 calculators. You can find additional 
instructions for using these calculators on the Texas Instruments (T1) 
website. 


Glossary 


Outlier 
An observation that does not fit the rest of the data. 


Histograms 

This module provides an overview of Descriptive Statistics: Histogram as a 
part of Collaborative Statistics collection (col10522) by Barbara Illowsky 
and Susan Dean. 


For most of the work you do in this book, you will use a histogram to 
display the data. One advantage of a histogram is that it can readily display 
large data sets. A rule of thumb is to use a histogram when the data set 
consists of 100 values or more. 


A histogram consists of contiguous boxes. It has both a horizontal axis and 
a vertical axis. The horizontal axis is labeled with what the data represents 
(for instance, distance from your home to school). The vertical axis is 
labeled either Frequency or relative frequency. The graph will have the 
same shape with either label. The histogram (like the stemplot) can give 
you the shape of the data, the center, and the spread of the data. (The next 
section tells you how to calculate the center and the spread.) 


The relative frequency is equal to the frequency for an observed value of 
the data divided by the total number of data values in the sample. (In the 
chapter on Sampling and Data, we defined frequency as the number of 
times an answer occurs.) If: 


e f = frequency 

e mn = total number of data values (or the sum of the individual 
frequencies), and 

¢ RF = relative frequency, 


then: 
Equation: 


RF = 2 
n 


For example, if 3 students in Mr. Ahab's English class of 40 students 
received from 90% to 100%, then, 


a = Gol tees Cola ce. 
f=3,n=40,andRF= — Go = 0.075 


Seven and a half percent of the students received 90% to 100%. Ninety 
percent to 100 % are quantitative measures. 


To construct a histogram, first decide how many bars or intervals, also 
called classes, represent the data. Many histograms consist of from 5 to 15 
bars or classes for clarity. Choose a starting point for the first interval to be 
less than the smallest data value. A convenient starting point is a lower 
value carried out to one more decimal place than the value with the most 
decimal places. For example, if the value with the most decimal places is 
6.1 and this is the smallest value, a convenient starting point is 6.05 (6.1 - 
0.05 = 6.05). We say that 6.05 has more precision. If the value with the 
most decimal places is 2.23 and the lowest value is 1.5, a convenient 
Starting point is 1.495 (1.5 - 0.005 = 1.495). If the value with the most 
decimal places is 3.234 and the lowest value is 1.0, a convenient starting 
point is 0.9995 (1.0 - .0005 = 0.9995). If all the data happen to be integers 
and the smallest value is 2, then a convenient starting point is 1.5 (2 - 0.5 = 
1.5). Also, when the starting point and other boundaries are carried to one 
additional decimal place, no data value will fall on a boundary. 


Example: 

The following data are the heights (in inches to the nearest half inch) of 
100 male semiprofessional soccer players. The heights are continuous data 
since height is measured. 

60 60.5 61 61 61.5 

63.5 63.5 63.5 

64 64 64 64 64 64 64 64.5 64.5 64.5 64.5 64.5 64.5 64.5 64.5 

66 66 66 66 66 66 66 66 66 66 66.5 66.5 66.5 66.5 66.5 66.5 66.5 66.5 
66:5°66.5.56.0.67 67 67 67 67 67 67.67 67 67 67 57 67.5679 67.5675 
OO Osc 0723 

66-08 69:69 16959 69 69'69'69 6969. 69.5 69.5-69.9 0015 Gor 

7070-70 7070 70;70.5: 7059 70.9 71 71 7A 

T2722 72 2 oO 3-8 

74 


The smallest data value is 60. Since the data with the most decimal places 
has one decimal (for instance, 61.5), we want our starting point to have two 
decimal places. Since the numbers 0.5, 0.05, 0.005, etc. are convenient 
numbers, use 0.05 and subtract it from 60, the smallest value, for the 
convenient starting point. 

60 - 0.05 = 59.95 which is more precise than, say, 61.5 by one decimal 
place. The starting point is, then, 59.95. 

The largest value is 74. 74+ 0.05 = 74.05 is the ending value. 

Next, calculate the width of each bar or class interval. To calculate this 
width, subtract the starting point from the ending value and divide by the 
number of bars (you must choose the number of bars you desire). Suppose 
you choose 8 bars. 

Equation: 


74.05 — 59.95 


— eG 
8 


Note: We will round up to 2 and make each bar or class interval 2 units 
wide. Rounding up to 2 is one way to prevent a value from falling on a 
boundary. Rounding to the next number is necessary even if it goes 
against the standard rules of rounding. For this example, using 1.76 as the 
width would also work. 


The boundaries are: 


* 59.95 

Li trayw elo sae nee on Less) 
Lda ee eae ak oo} 9/8) 
S26) Joe too 
© Ga oee 7195 
LAV rehe sae eee fa) 
eeOo ore = liao 
e 71.95 + 2 = 73.95 


73952 = / aos 


The heights 60 through 61.5 inches are in the interval 59.95 - 61.95. The 
heights that are 63.5 are in the interval 61.95 - 63.95. The heights that are 
64 through 64.5 are in the interval 63.95 - 65.95. The heights 66 through 
67.5 are in the interval 65.95 - 67.95. The heights 68 through 69.5 are in 
the interval 67.95 - 69.95. The heights 70 through 71 are in the interval 
69.95 - 71.95. The heights 72 through 73.5 are in the interval 71.95 - 
73.95. The height 74 is in the interval 73.95 - 75.95. 

The following histogram displays the heights on the x-axis and relative 
frequency on the y-axis. 


Relative 
Frequency 


04 


59.95 61.95 63.95 65.95 67.95 69.95 71.95 73.95 75.95 


Heights 


Example: 
The following data are the number of books bought by 50 part-time college 
students at ABC College. The number of books is discrete data since books 


are counted. 

SoD ene Reale Aly hela 

Dee ee 

Sicushenershe mel oeomelogele roi, 

444444 

Deore 

66 

Eleven students buy 1 book. Ten students buy 2 books. Sixteen students 
buy 3 books. Six students buy 4 books. Five students buy 5 books. Two 
students buy 6 books. 

Because the data are integers, subtract 0.5 from 1, the smallest data value 
and add 0.5 to 6, the largest data value. Then the starting point is 0.5 and 
the ending value is 6.5. 

Exercise: 


Problem: 


Next, calculate the width of each bar or class interval. If the data are 
discrete and there are not too many different values, a width that 
places the data values in the middle of the bar or class interval is the 
most convenient. Since the data consist of the numbers 1, 2, 3, 4, 5, 6 
and the starting point is 0.5, a width of one places the 1 in the middle 
of the interval from 0.5 to 1.5, the 2 in the middle of the interval from 
1.5 to 2.5, the 3 in the middle of the interval from 2.5 to 3.5, the 4 in 
the middle of the interval from to , the 5 in the 
middle of the interval from to , and the in 
the middle of the interval from to 


Solution: 


e 3.5t0 4.5 
e 4.5t05.5 
° 6 

e 5.5 to 6.5 


Calculate the number of bars as follows: 
Equation: 


6.5—0.5 _ 1 
bars 


where 1 is the width of a bar. Therefore, bars = 6. 
The following histogram displays the number of books on the x-axis and 


the frequency on the y-axis. 


16 
14__ 
12__ 
1 
Py 
3 
= 
g 
i 
2 
0.5 1.5 2.5 a5 4.5 3 6.5 


Number of Books 


Using the TI-83, 83+, 84, 84+ Calculator Instructions 

Go to the Appendix (14:Appendix) in the menu on the left. There are 
calculator instructions for entering data and for creating a customized 
histogram. Create the histogram for Example 2. 


e Press Y=. Press CLEAR to clear out any equations. 

e Press STAT 1:EDIT. If L1 has data in it, arrow up into the name L1, 
press CLEAR and arrow down. If necessary, do the same for L2. 

e Into L1, enter 1, 2, 3, 4, 5,6 

e Into L2, enter 11, 10, 16, 6, 5, 2 

e Press WINDOW. Make Xmin = .5, Xmax = 6.5, Xscl = (6.5 - .5)/6, 
Ymin = -1, Ymax = 20, Yscl = 1, Xres = 1 


e Press 2nd Y=. Start by pressing 4:Plotsoff ENTER. 

e Press 2nd Y=. Press 1:Plot1. Press ENTER. Arrow down to TYPE. 
Arrow to the 3rd picture (histogram). Press ENTER. 

e Arrow down to Xlist: Enter L1 (2nd 1). Arrow down to Freq. Enter L2 
(2nd 2). 

e Press GRAPH 

e Use the TRACE key and the arrow keys to examine the histogram. 


Optional Collaborative Exercise 


Count the money (bills and change) in your pocket or purse. Your instructor 
will record the amounts. As a class, construct a histogram displaying the 
data. Discuss how many intervals you think is appropriate. You may want to 
experiment with the number of intervals. Discuss, also, the shape of the 
histogram. 


Record the data, in dollars (for example, 1.25 dollars). 


Construct a histogram. 


Glossary 


Frequency 
The number of times a value of the data occurs. 


Relative Frequency 
The ratio of the number of times a value of the data occurs in the set of 
all outcomes to the number of all outcomes. 


Box Plots 


Box plots or box-whisker plots give a good graphical image of the 
concentration of the data. They also show how far from most of the data the 
extreme values are. The box plot is constructed from five values: the 
smallest value, the first quartile, the median, the third quartile, and the 
largest value. The median, the first quartile, and the third quartile will be 
discussed here, and then again in the section on measuring data in this 
chapter. We use these values to compare how close other data values are to 
them. 


The median, a number, is a way of measuring the "center" of the data. You 
can think of the median as the "middle value," although it does not actually 
have to be one of the observed values. It is a number that separates ordered 
data into halves. Half the values are the same number or smaller than the 
median and half the values are the same number or larger. For example, 
consider the following data: 


111.567.248910688322101 
Ordered from smallest to largest: 
11224668 7.288.39101011.5 


The median is between the 7th value, 6.8, and the 8th value 7.2. To find the 
median, add the two values together and divide by 2. 
Equation: 


6847.2 _ 


7 
2 


The median is 7. Half of the values are smaller than 7 and half of the values 
are larger than 7. 


Quartiles are numbers that separate the data into quarters. Quartiles may or 
may not be part of the data. To find the quartiles, first find the median or 
second quartile. The first quartile is the middle value of the lower half of 


the data and the third quartile is the middle value of the upper half of the 
data. To get the idea, consider the same data set shown above: 


112246687.28839101011.5 


The median or second quartile is 7. The lower half of the data is 1, 1, 2, 2, 
4, 6, 6.8. The middle value of the lower half is 2. 


11224668 


The number 2, which is part of the data, is the first quartile. One-fourth of 
the values are the same or less than 2 and three-fourths of the values are 
more than 2. 


The upper half of the data is 7.2, 8, 8.3, 9, 10, 10, 11.5. The middle value of 
the upper half is 9. 


7.288.39 1010 11.5 


The number 9, which is part of the data, is the third quartile. Three-fourths 
of the values are less than 9 and one-fourth of the values are more than 9. 


To construct a box plot, use a horizontal number line and a rectangular box. 
The smallest and largest data values label the endpoints of the axis. The first 
quartile marks one end of the box and the third quartile marks the other end 
of the box. The middle fifty percent of the data fall inside the box. The 
"whiskers" extend from the ends of the box to the smallest and largest data 
values. The box plot gives a good quick picture of the data. 


Note: You may encounter box and whisker plots that have dots marking 
outlier values. In those cases, the whiskers are not extending to the 
minimum and maximum values. 


Consider the following data: 


112246687.28839101011.5 


The first quartile is 2, the median is 7, and the third quartile is 9. The 
smallest value is 1 and the largest value is 11.5. The box plot is constructed 
as follows (see calculator instructions in the back of this book or on the TI 
web site): 


1 2 K - 5 6 7 8 9 10 11 11.5 


The two whiskers extend from the first quartile to the smallest value and 
from the third quartile to the largest value. The median is shown with a 
dashed line. 


Example: 

The following data are the heights of 40 students in a statistics class. 

59 60 61 62 62 63 63 64 64 64 65 65 65 65 65 65 65 65 65 66 66 67 67 68 
08 09! 70 70°70 70 70 71 71-72 72 73 7474 Ja 77 

Construct a box plot: 

Using the TI-83, 83+, 84, 84+ Calculator 


e Enter data into the list editor (Press STAT 1:EDIT). If you need to 
clear the list, arrow up to the name L1, press CLEAR, arrow down. 

e Put the data values in list L1. 

e Press STAT and arrow to CALC. Press 1:1-VarStats. Enter L1. 

e Press ENTER 

e Use the down and up arrow keys to scroll. 


e Smallest value = 59 
e Largest value = 77 
e Q1: First quartile = 64.5 


e Q2: Second quartile or median= 66 
¢ Q3: Third quartile = 70 


Using the TI-83, 83+, 84, 84+ to Construct the Box Plot 
Go to 14:Appendix for Notes for the TI-83, 83+, 84, 84+ Calculator. To 
create the box plot: 


e Press Y=. If there are any equations, press CLEAR to clear them. 

e Press 2nd Y=. 

e Press 4:Plotsoff. Press ENTER 

e Press 2nd Y= 

e Press 1:Ploti. Press ENTER. 

e Arrow down and then use the right arrow key to go to the 5th picture 
which is the box plot. Press ENTER. 

e Arrow down to Xlist: Press 2nd 1 for L1 

e Arrow down to Freq: Press ALPHA. Press 1. 

e Press ZOOM. Press 9:ZoomStat. 

e Press TRACE and use the arrow keys to examine the box plot. 


59 645 66 70 17 


e aEach quarter has 25% of the data. 

e bThe spreads of the four quarters are 64.5 - 59 = 5.5 (first quarter), 66 
- 64.5 = 1.5 (second quarter), 70 - 66 = 4 (3rd quarter), and 77 - 70 = 
7 (fourth quarter). So, the second quarter has the smallest spread and 
the fourth quarter has the largest spread. 

e cinterquartile Range: IQR = Q3 — Q1 = 70 — 64.5 = 5.5. 

e dThe interval 59 through 65 has more than 25% of the data so it has 
more data in it than the interval 66 through 70 which has 25% of the 
data. 

e eThe middle 50% (middle half) of the data has a range of 5.5 inches. 


For some sets of data, some of the largest value, smallest value, first 
quartile, median, and third quartile may be the same. For instance, you 
might have a data set in which the median and the third quartile are the 
same. In this case, the diagram would not have a dotted line inside the box 
displaying the median. The right side of the box would display both the 
third quartile and the median. For example, if the smallest value and the 
first quartile were both 1, the median and the third quartile were both 5, 
and the largest value was 7, the box plot would look as follows: 


Example: 

Test scores for a college statistics class held during the day are: 

99 56 78 55.5 32 90 80 81 56 59 45 77 84.5 84 70 72 68 32 79 90 

Test scores for a college statistics class held during the evening are: 

98 78 68 83 81 89 88 76 65 45 98 90 80 84.5 85 79 78 98 90 79 81 25.5 
Exercise: 


Problem: 


e What are the smallest and largest data values for each data set? 

e¢ What is the median, the first quartile, and the third quartile for 
each data set? 

e Create a boxplot for each set of data. 

e¢ Which boxplot has the widest spread for the middle 50% of the 
data (the data between the first and third quartiles)? What does 
this mean for that set of data in comparison to the other set of 
data? 


e For each data set, what percent of the data is between the 
smallest value and the first quartile? (Answer: 25%) the first 
quartile and the median? (Answer: 25%) the median and the third 
quartile? the third quartile and the largest value? What percent of 
the data is between the first quartile and the largest value? 
(Answer: 75%) 


Solution: 
First Data Set 


e Xmin = 32 
«Oil 56 

e M = 74.5 
* (O3— 82:5 
e Xmax = 99 


Second Data Set 

e Xmin = 25.5 
Or 71s 
M=8l 


Q3 = 89 
Xmax = 98 


—L_i FF — 
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The first data set (the top box plot) has the widest spread for the middle 
50% of the data. IQR = Q3 — Q1 is 82.5 — 56 = 26.5 for the first data 
set and 89 — 78 = 11 for the second data set. So, the first set of data has 
its middle 50% of scores more spread out. 

25% of the data is between M and Q3 and 25% is between Q3 and Xmax. 


Glossary 


Median 
A number that separates ordered data into halves. Half the values are 
the same number or smaller than the median and half the values are the 
same number or larger than the median. The median may or may not 
be part of the data. 


Quartiles 
The numbers that separate the data into quarters. Quartiles may or may 
not be part of the data. The second quartile is the median of the data. 


Measures of the Location of the Data 

Descriptive Statistics: Measuring the Location of Data explains percentiles and 
quartiles and is part of the collection col10555 written by Barbara Illowsky and 
Susan Dean. Roberta Bloom contributed the section "Interpreting Percentiles, 
Quartile and the Median." 


The common measures of location are quartiles and percentiles (%iles). Quartiles 
are special percentiles. The first quartile, Q ; is the same as the 25th percentile 
(25th %ile) and the third quartile, @ 3, is the same as the 75th percentile (75th 
%ile). The median, M, is called both the second quartile and the 50th percentile 
(50th %ile). 


Note: Quartiles are given special attention in the Box Plots module in this chapter. 


To calculate quartiles and percentiles, the data must be ordered from smallest to 
largest. Recall that quartiles divide ordered data into quarters. Percentiles divide 
ordered data into hundredths. To score in the 90th percentile of an exam does not 
mean, necessarily, that you received 90% on a test. It means that 90% of test 
scores are the same or less than your score and 10% of the test scores are the same 
or greater than your test score. 


Percentiles are useful for comparing values. For this reason, universities and 
colleges use percentiles extensively. 


Percentiles are mostly used with very large populations. Therefore, if you were to 
say that 90% of the test scores are less (and not the same or less) than your score, 
it would be acceptable because removing one particular data value is not 
significant. 


The interquartile range is a number that indicates the spread of the middle half 
or the middle 50% of the data. It is the difference between the third quartile (Q 3) 
and the first quartile (Q 1). 

Equation: 


IQR = Q3— Qi 


The IQR can help to determine potential outliers. A value is suspected to be a 
potential outlier if it is less than (1.5)(IQR) below the first quartile or more 
than (1.5)(IQR) above the third quartile. Potential outliers always need further 
investigation. 


Example: 
Exercise: 


Problem: 

For the following 13 real estate prices, calculate the IQR and determine if 
any prices are outliers. Prices are in dollars. (Source: San Jose Mercury 
News) 


389,950 230,500 158,000 479,000 639,000 114,950 5,500,000 387,000 
659,000 529,000 575,000 488,800 1,095,000 


Solution: 


Order the data from smallest to largest. 


114,950 158,000 230,500 387,000 389,950 479,000 488,800 529,000 
975,000 639,000 659,000 1,095,000 5,500,000 


M = 488,800 

Qy = 20800387000 — 308750 

Qz = $82000+859000 — 649000 

IQR = 649000 — 308750 = 340250 

(1.5)(IQR) = (1.5)(340250) = 510375 

Qi — (1.5)(IQR) = 308750 — 510375 = —201625 
Q3 + (1.5)(IQR) = 649000 + 510375 = 1159375 


No house price is less than -201625. However, 5,500,000 is more than 
1,159,375. Therefore, 5,500,000 is a potential outlier. 


Example: 
Exercise: 


Problem: 
For the two data sets in the test scores example, find the following: 


e aThe interquartile range. Compare the two interquartile ranges. 

e bAny outliers in either set. 

¢ cThe 30th percentile and the 80th percentile for each set. How much 
data falls below the 30th percentile? Above the 80th percentile? 


Solution: 


For the IQRs, see the answer to the test scores example. The first data set has 
the larger IQR, so the scores between Q3 and Q1 (middle 50%) for the first 
data set are more spread out and not clustered about the median. 


First Data Set 


¢ (2) - (IQR) = (2) - (26.5) = 39.75 
e Xmax - Q3 = 99 - 82.5 = 1 


(3) : (IQR) = 39.75 is larger than 16.5 and larger than 24, so the first set 
has no outliers. 


Second Data Set 
(+) - (IQR) = (>) - (11) = 16.5 
e Xmax — Q3 = 98 — 89 = 9 
e QI — Xmin = 78 — 25.5 = 52.5 


= : (IQR) = 16.5 is larger than 9 but smaller than 52.5, so for the 
second set 45 and 25.5 are outliers. 


To find the percentiles, create a frequency, relative frequency, and 


Data Chapter). Get the percentiles from that chart. 
First Data Set 


¢ 30th %ile (between the 6th and 7th values) = pote) = iH 


80th %ile (between the 16th and 17th values) = en) = 84.25 
Second Data Set 


¢ 30th %ile (7th value) = 78 
° 80th %ile (18th value) = 90 


30% of the data falls below the 30th %ile, and 20% falls above the 80th 
%ile. 


Example: 

Finding Quartiles and Percentiles Using a Table 

Fifty statistics students were asked how much sleep they get per school night 
(rounded to the nearest hour). The results were (student data): 


AMOUNT 

OF 

SLEEP 

PER 

SCHOOL CUMULATIVE 
NIGHT RELATIVE RELATIVE 
(HOURS) FREQUENCY FREQUENCY FREQUENCY 


4 2 0.04 0.04 


fs) fs) 0.10 0.14 


AMOUNT 


OF 

SLEEP 

PER 

SCHOOL CUMULATIVE 
NIGHT RELATIVE RELATIVE 


(HOURS) FREQUENCY FREQUENCY FREQUENCY 


6 7 0.14 0.28 
ye 12 0.24 0.52 
8 14 0.28 0.80 
9 7. 0.14 0.94 
10 3 0.06 1.00 


Find the 28th percentile: Notice the 0.28 in the "cumulative relative frequency" 
column. 28% of 50 data values = 14. There are 14 values less than the 28th %ile. 
They include the two 4s, the five 5s, and the seven 6s. The 28th %ile is between 
the last 6 and the first 7. The 28th %ile is 6.5. 

Find the median: Look again at the "cumulative relative frequency " column and 
find 0.52. The median is the 50th %ile or the second quartile. 50% of 50 = 25. 
There are 25 values less than the median. They include the two 4s, the five 5s, the 
seven 6s, and eleven of the 7s. The median or 50th %ile is between the 25th (7) 
and 26th (7) values. The median is 7. 

Find the third quartile: The third quartile is the same as the 75th percentile. You 
can "eyeball" this answer. If you look at the "cumulative relative frequency" 
column, you find 0.52 and 0.80. When you have all the 4s, 5s, 6s and 7s, you 
have 52% of the data. When you include all the 8s, you have 80% of the data. 
The 75th “%ile, then, must be an 8 . Another way to look at the problem is to 
find 75% of 50 (= 37.5) and round up to 38. The third quartile, Q 3, is the 38th 
value which is an 8. You can check this answer by counting the values. (There are 
37 values below the third quartile and 12 values above.) 


Example: 


Exercise: 


Problem: Using the table: 


1. Find the 80th percentile. 

2. Find the 90th percentile. 

3. Find the first quartile. 

4. What is another name for the first quartile? 


Solution: 


pe = BE 
5 = 8. 
Look where cum. rel. freg. = 0.80. 80% of the data is 8 or less. 80th 
%ile is between the last 8 and first 9. 
Das 
Sie) 
4. First Quartile = 25th %ile 


Collaborative Classroom Exercise: Your instructor or a member of the class will 
ask everyone in class how many sweaters they own. Answer the following 
questions. 


1. How many students were surveyed? 

2. What kind of sampling did you do? 

3. Construct a table of the data. 

4. Construct 2 different histograms. For each, starting value = ending 
value= 

5. Use the table to find the median, first quartile, and third quartile. 

6. Construct a box plot. 

7. Use the table to find the following: 


o The 10th percentile 
o The 70th percentile 
o The percent of students who own less than 4 sweaters 


Interpreting Percentiles, Quartiles, and Median 


A percentile indicates the relative standing of a data value when data are sorted 
into numerical order, from smallest to largest. p% of data values are less than or 
equal to the pth percentile. For example, 15% of data values are less than or equal 
to the 15th percentile. 


¢ Low percentiles always correspond to lower data values. 
e High percentiles always correspond to higher data values. 


A percentile may or may not correspond to a value judgment about whether it is 
"good" or "bad". The interpretation of whether a certain percentile is good or bad 
depends on the context of the situation to which the data applies. In some 
situations, a low percentile would be considered "good'; in other contexts a high 
percentile might be considered "good". In many situations, there is no value 
judgment that applies. 


Understanding how to properly interpret percentiles is important not only when 
describing data, but is also important in later chapters of this textbook when 
calculating probabilities. 


Guideline: 


When writing the interpretation of a percentile in the context of the given data, the 
sentence should contain the following information: 


e information about the context of the situation being considered, 

e the data value (value of the variable) that represents the percentile, 

e the percent of individuals or items with data values below the percentile. 

e Additionally, you may also choose to state the percent of individuals or items 
with data values above the percentile. 


Example: 
On a timed math test, the first quartile for times for finishing the exam was 35 
minutes. Interpret the first quartile in the context of this situation. 


e 25% of students finished the exam in 35 minutes or less. 

e 75% of students finished the exam in 35 minutes or more. 

e A low percentile could be considered good, as finishing more quickly on a 
timed exam is desirable. (If you take too long, you might not be able to 
finish.) 


Example: 
On a 20 question math test, the 70th percentile for number of correct answers was 
16. Interpret the 70th percentile in the context of this situation. 


¢ 70% of students answered 16 or fewer questions correctly. 

e 30% of students answered 16 or more questions correctly. 

e Note: A high percentile could be considered good, as answering more 
questions correctly is desirable. 


Example: 

At a certain community college, it was found that the 30th percentile of credit 
units that students are enrolled for is 7 units. Interpret the 30th percentile in the 
context of this situation. 


¢ 30% of students are enrolled in 7 or fewer credit units 

e 70% of students are enrolled in 7 or more credit units 

e In this example, there is no "good" or "bad" value judgment associated with 
a higher or lower percentile. Students attend community college for varied 
reasons and needs, and their course load varies according to their needs. 


Do the following Practice Problems for Interpreting Percentiles 
Exercise: 


Problem: 


e a For runners in arace, a low time means a faster run. The winners in a 
race have the shortest running times. Is it more desirable to have a finish 
time with a high or a low percentile when running a race? 

¢ b The 20th percentile of run times in a particular race is 5.2 minutes. 
Write a sentence interpreting the 20th percentile in the context of the 
situation. 


e cA bicyclist in the 90th percentile of a bicycle race between two towns 
completed the race in 1 hour and 12 minutes. Is he among the fastest or 
slowest cyclists in the race? Write a sentence interpreting the 90th 
percentile in the context of the situation. 


Solution: 


e a Forrunners in a race it is more desirable to have a low percentile for 
finish time. A low percentile means a short time, which is faster. 

¢ bINTERPRETATION: 20% of runners finished the race in 5.2 minutes 
or less. 80% of runners finished the race in 5.2 minutes or longer. 

¢ cHe is among the slowest cyclists (90% of cyclists were faster than 
him.) INTERPRETATION: 90% of cyclists had a finish time of 1 hour, 
12 minutes or less.Only 10% of cyclists had a finish time of 1 hour, 12 
minutes or longer 


Exercise: 


Problem: 


e a For runners in a race, a higher speed means a faster run. Is it more 
desirable to have a speed with a high or a low percentile when running a 
race? 

e bThe 40th percentile of speeds in a particular race is 7.5 miles per hour. 
Write a sentence interpreting the 40th percentile in the context of the 


situation. 


Solution: 


e aFor runners in a race it is more desirable to have a high percentile for 
speed. A high percentile means a higher speed, which is faster. 

¢ bINTERPRETATION: 40% of runners ran at speeds of 7.5 miles per 
hour or less (slower). 60% of runners ran at speeds of 7.5 miles per hour 
or more (faster). 


Exercise: 


Problem: 


On an exam, would it be more desirable to earn a grade with a high or low 
percentile? Explain. 


Solution: 
On an exam you would prefer a high percentile; higher percentiles 
correspond to higher grades on the exam. 

Exercise: 
Problem: 
Mina is waiting in line at the Department of Motor Vehicles (DMV). Her wait 
time of 32 minutes is the 85th percentile of wait times. Is that good or bad? 


Write a sentence interpreting the 85th percentile in the context of this 
situation. 


Solution: 


When waiting in line at the DMV, the 85th percentile would be a long wait 
time compared to the other people waiting. 85% of people had shorter wait 
times than you did. In this context, you would prefer a wait time 
corresponding to a lower percentile. INTERPRETATION: 85% of people at 
the DMV waited 32 minutes or less. 15% of people at the DMV waited 32 
minutes or longer. 


Exercise: 
Problem: 
In a survey collecting data about the salaries earned by recent college 


graduates, Li found that her salary was in the 78th percentile. Should Li be 
pleased or upset by this result? Explain. 


Solution: 


Li should be pleased. Her salary is relatively high compared to other recent 
college grads. 78% of recent college graduates earn less than Li does. 22% of 
recent college graduates earn more than Li does. 


Exercise: 


Problem: 


In a study collecting data about the repair costs of damage to automobiles in a 
certain type of crash tests, a certain model of car had $1700 in damage and 
was in the 90th percentile. Should the manufacturer and/or a consumer be 
pleased or upset by this result? Explain. Write a sentence that interprets the 
90th percentile in the context of this problem. 


Solution: 


The manufacturer and the consumer would be upset. This is a large repair 
cost for the damages, compared to the other cars in the sample. 
INTERPRETATION: 90% of the crash tested cars had damage repair costs of 
$1700 or less; only 10% had damage repair costs of $1700 or more. 


Exercise: 


Problem: 


e The University of California has two criteria used to set admission 
standards for freshman to be admitted to a college in the UC system: 

e a. Students' GPAs and scores on standardized tests (SATs and ACTs) are 
entered into a formula that calculates an "admissions index" score. The 
admissions index score is used to set eligibility standards intended to 
meet the goal of admitting the top 12% of high school students in the 
state. In this context, what percentile does the top 12% represent? 

e b. Students whose GPAs are at or above the 96th percentile of all 
students at their high school are eligible (called eligible in the local 
context), even if they are not in the top 12% of all students in the state. 
What percent of students from each high school are "eligible in the local 
context"? 


Solution: 
¢ aThe top 12% of students are those who are at or above the 88th 
percentile of admissions index scores. 


¢ b The top 4% of students' GPAs are at or above the 96th percentile, 
making the top 4% of students "eligible in the local context". 


Exercise: 


Problem: 


Suppose that you are buying a house. You and your realtor have determined 
that the most expensive house you can afford is the 34th percentile. The 34th 
percentile of housing prices is $240,000 in the town you want to move to. In 
this town, can you afford 34% of the houses or 66% of the houses? 


Solution: 


You can afford 34% of houses. 66% of the houses are too expensive for your 
budget. INTERPRETATION: 34% of houses cost $240,000 or less. 66% of 
houses cost $240,000 or more. 


**With contributions from Roberta Bloom 


Glossary 


Interquartile Range (IRQ) 
The distance between the third quartile (Q3) and the first quartile (Q1). IQR 
= Q3 - Ql. 


Outlier 
An observation that does not fit the rest of the data. 


Percentile 
A number that divides ordered data into hundredths. 


Example: 
Let a data set contain 200 ordered observations starting with 


{2.3,2.7,2.8,2.9,2.9,3.0...}. Then the first percentile is @7?*) — 9.75, 


because 1% of the data is to the left of this point on the number line and 99% of 


hae! eho 0n 2: ; 
the data is on its right. The second percentile is ( = *) — 2.9. Percentiles may 


or may not be part of the data. In this example, the first percentile is not in the 
data, but the second percentile is. The median of the data is the second quartile 
and the 50th percentile. The first and third quartiles are the 25th and the 75th 
percentiles, respectively. 


Quartiles 
The numbers that separate the data into quarters. Quartiles may or may not be 
part of the data. The second quartile is the median of the data. 


Measures of the Center of the Data 
This chapter discusses measuring descriptive statistical information using the 
center of the data 


The "center" of a data set is also a way of describing location. The two most 
widely used measures of the "center" of the data are the mean (average) and the 
median. To calculate the mean weight of 50 people, add the 50 weights 
together and divide by 50. To find the median weight of the 50 people, order 
the data and find the number that splits the data into two equal parts (previously 
discussed under box plots in this chapter). The median is generally a better 
measure of the center when there are extreme values or outliers because it is not 
affected by the precise numerical values of the outliers. The mean is the most 
common measure of the center. 


Note:The words "mean" and "average" are often used interchangeably. The 
substitution of one word for the other is common practice. The technical term 
is "arithmetic mean" and "average" is technically a center location. However, 
in practice among non-statisticians, "average" is commonly accepted for 
"arithmetic mean.” 


The mean can also be calculated by multiplying each distinct value by its 
frequency and then dividing the sum by the total number of data values. The 
letter used to represent the sample mean is an x with a bar over it (pronounced 
"e Dal ix, 


The Greek letter js (pronounced "mew" ) represents the population mean. One 
of the requirements for the sample mean to be a good estimate of the population 
mean is for the sample taken to be truly random. 


To see that both ways of calculating the mean are the same, consider the 
sample: 


11122344444 
Equation: 


1+14+1+24+24+34+44+4+4+4+4 
OS SSS eS ee eS SS 
11 


2.7 


Equation: 


3x14+2x24+1x3+5x4 
O————————— 
11 


2.0 


In the second calculation for the sample mean, the frequencies are 3, 2, 1, and 
De 

You can quickly find the location of the median by using the expression — 
The letter n is the total number of data values in the sample. If n is an odd 
number, the median is the middle value of the ordered data (ordered smallest to 
largest). If n is an even number, the median is equal to the two middle values 
added together and divided by 2 after the data has been ordered. For example, if 
the total number of data values is 97, then oa = —— = 49. The median is the 
49th value in the ordered data. If the total number of data values is 100, then 
igs = we = 50.5. The median occurs midway between the 50th and 51st 
values. The location of the median and the value of the median are not the 
same. The upper case letter (V is often used to represent the median. The next 
example illustrates the location of the median and the value of the median. 


Example: 
Exercise: 


Problem: 


AIDS data indicating the number of months an AIDS patient lives after 
taking a new antibody drug are as follows (smallest to largest): 


3488 1011121314151516161717182122222424252626272729293132333 
33434353740444447 


Calculate the mean and the median. 


Solution: 


The calculation for the mean is: 


= 23.6 


ia [3+4+(8)(2)+10+11+12+13+414+(15)(2)+(16)(2)+...+35+37+40+(44) (2)+47| 
<4 40 


To find the median, M, first use the formula for the location. The location 
is: 


far —. sel __ 
oR 


Starting at the smallest value, the median is located between the 20th and 
21st values (the two 24s): 


34881011121314151516161717182122222424 
25262627272929313233333434353740444447 


M= — =n 


The median is 24. 


Using the TI-83,83+,84, 84+ Calculators 
Calculator Instructions are located in the menu item 14:Appendix (Notes for 
the TI-83, 83+, 84, 84+ Calculators). 


e Enter data into the list editor. Press STAT 1:EDIT 

e Put the data values in list L1. 

e Press STAT and arrow to CALC. Press 1:1-VarStats. Press 2nd 1 for L1 
and ENTER. 

e Press the down and up arrow keys to scroll. 


ec = 23.6, M = 24 


Example: 
Exercise: 


Problem: 
Suppose that, in a small town of 50 people, one person earns $5,000,000 


per year and the other 49 each earn $30,000. Which is the better measure 
of the "center," the mean or the median? 


Solution: 


= es ae — 129400 
M = 30000 


(There are 49 people who earn $30,000 and one person who earns 
$5,000,000.) 


The median is a better measure of the "center" than the mean because 49 
of the values are 30,000 and one is 5,000,000. The 5,000,000 is an outlier. 
The 30,000 gives us a better sense of the middle of the data. 


Another measure of the center is the mode. The mode is the most frequent 
value. If a data set has two values that occur the same number of times, then the 
set is bimodal. 


Example: 

Statistics exam scores for 20 students are as follows 
Statistics exam scores for 20 students are as follows: 
5055.59 59°63 63 72 72 72 72 72:76 7861 63:64 6484 90153 
Exercise: 


Problem:Find the mode. 
Solution: 


The most frequent score is 72, which occurs five times. Mode = 72. 


Example: 
Five real estate exam scores are 430, 430, 480, 480, 495. The data set is 
bimodal because the scores 430 and 480 each occur twice. 


When is the mode the best measure of the "center"? Consider a weight loss 
program that advertises a mean weight loss of six pounds the first week of the 
program. The mode might indicate that most people lose two pounds the first 
week, making the program less appealing. 


Note:The mode can be calculated for qualitative data as well as for 
quantitative data. 


Statistical software will easily calculate the mean, the median, and the mode. 
Some graphing calculators can also make these calculations. In the real world, 
people make these calculations using software. 


The Law of Large Numbers and the Mean 


The Law of Large Numbers says that if you take samples of larger and larger 
size from any population, then the mean z of the sample is very likely to get 
closer and closer to p. This is discussed in more detail in The Central Limit 
Theorem. 


Note:The formula for the mean is located in the Summary of Formulas section 
course. 


Sampling Distributions and Statistic of a Sampling Distribution 


You can think of a sampling distribution as a relative frequency distribution 
with a great many samples. (See Sampling and Data for a review of relative 
frequency). Suppose thirty randomly selected students were asked the number 
of movies they watched the previous week. The results are in the relative 
frequency table shown below. 


# of movies Relative Frequency 


0 


5/30 


15/30 


6/30 


4/30 


1/30 


If you let the number of samples get very large (say, 300 million or more), 
the relative frequency table becomes a relative frequency distribution. 


A statistic is a number calculated from a sample. Statistic examples include the 
mean, the median and the mode as well as others. The sample mean z is an 
example of a statistic which estimates the population mean . 


Glossary 


Mean 


A number that measures the central tendency. A common name for mean 
is ‘average.’ The term 'mean' is a shortened form of ‘arithmetic mean.' By 


definition, the mean for a sample (denoted by 2) is 


Sum of all values in th 1 , 
ugbecot oslucsin theasmcle® and the mean for a population (denoted by 


) isu = Sum of all values in the population 
be /t = Number of values in the population * 


| 


Median 


A number that separates ordered data into halves. Half the values are the 
same number or smaller than the median and half the values are the same 
number or larger than the median. The median may or may not be part of 
the data. 


Mode 


The value that appears most frequently in a set of data. 


Skewness and the Mean, Median, and Mode 
Consider the following data set: 
456667777778836910 


This data set produces the histogram shown below. Each interval has width 
one and each value is located in the middle of an interval. 


4 5 6 7 8 9 10 


The histogram displays a symmetrical distribution of data. A distribution is 
symmetrical if a vertical line can be drawn at some point in the histogram 
such that the shape to the left and the right of the vertical line are mirror 
images of each other. The mean, the median, and the mode are each 7 for 
these data. In a perfectly symmetrical distribution, the mean and the 
median are the same. This example has one mode (unimodal) and the 
mode is the same as the mean and median. In a symmetrical distribution 
that has two modes (bimodal), the two modes would be different from the 
mean and median. 


The histogram for the data: 
4566677778 


is not symmetrical. The right-hand side seems "chopped off" compared to 
the left side. The shape distribution is called skewed to the left because it is 
pulled out to the left. 


4 5 6 7 8 


The mean is 6.3, the median is 6.5, and the mode is 7. Notice that the 
mean is less than the median and they are both less than the mode. The 
mean and the median both reflect the skewing but the mean more so. 


The histogram for the data: 
677778886910 


is also not symmetrical. It is skewed to the right. 


6 7 8 9 10 


The mean is 7.7, the median is 7.5, and the mode is 7. Of the three statistics, 
the mean is the largest, while the mode is the smallest. Again, the mean 
reflects the skewing the most. 


To summarize, generally if the distribution of data is skewed to the left, the 
mean is less than the median, which is often less than the mode. If the 
distribution of data is skewed to the right, the mode is often less than the 
median, which is less than the mean. 


Skewness and symmetry become important when we discuss probability 
distributions in later chapters. 


Measuring the Spread of the Data (modified R. Bloom) 
This module explains standard deviation as a measure of variation in data. The original module by Dr. B. Illowksy 
and S. Dean in the textbook collection Collaborative Statistics has been modified for this module. 


An important characteristic of any set of data is the variation in the data. In some data sets, the data values are 
concentrated closely near the mean; in other data sets, the data values are more widely spread out from the mean. 
The most common measure of variation, or spread, is the standard deviation. 


The standard deviation is a number that measures how far data values are from their mean. 
The standard deviation 


e provides a numerical measure of the overall amount of variation in a data set 
¢ can be used to determine whether a particular data value is close to or far from the mean 


First we will investigate what the standard deviation tells us about data; then we will learn to calculate the standard 
deviation. 


The standard deviation provides a measure of the overall variation in a data set 

The standard deviation is always positive or 0. The standard deviation is small when the data are all concentrated 
close to the mean, exhibiting little variation or spread. The standard deviation is larger when the data values are 
more spread out from the mean, exhibiting more variation. 


Suppose that we are studying waiting times at the checkout line for customers at supermarket A and supermarket 
B; the average wait time at both markets is 5 minutes. At market A, the standard deviation for the waiting time is 2 
minutes; at market B the standard deviation for the waiting time is 4 minutes. Because market B has a higher 
standard deviation, we know that there is more variation in the waiting times at market B. Overall, wait times at 
market B are more spread out from the average; wait times at market A are more concentrated near the average. 


The standard deviation can be used to determine whether a data value is close to or far from the mean. 
Suppose that Rosa and Binh both shop at Market A. Rosa waits for 7 minutes and Binh waits for 1 minute at the 
checkout counter. At market A, the mean wait time is 5 minutes and the standard deviation is 2 minutes. 

Rosa waits for 7 minutes: 


e 7 is 2 minutes longer than the average of 5; 2 minutes is equal to one standard deviation. 

¢ Rosa's wait time of 7 minutes is 2 minutes longer than the average of 5 minutes. 

¢ Rosa's wait time of 7 minutes is one standard deviation above the average of 5 minutes. 

e A wait time that is only one standard deviation from the average is considered close to the average. 


Binh waits for 1 minute: 


e 1is 4 minutes less than the average of 5; 4 minutes is equal to two standard deviations. 

¢ Binh's wait time of 1 minute is 4 minutes less than the average of 5 minutes. 

e Binh's wait time of 1 minute is two standard deviations below the average of 5 minutes. 

e A data value that is two standard deviations from the average is just on the borderline for what many 
statisticians would consider to be far from the average. Considering data to be far from the mean if it is more 
than 2 standard deviations away is more of an approximate "rule of thumb" than a rigid rule. In general, the 
shape of the distribution of the data affects how much of the data is further away than 2 standard deviations. 
(We will learn more about this in later chapters.) 


e In general, a value = mean + (#ofSTDEVs)(standard deviation) 

e where #0fSTDEVs = the number of standard deviations 

e 7 is one standard deviation more than the mean of 5 because: 7=5+(1)(2) 
e 1 is two standard deviations less than the mean of 5 because: 1=5+(—2)(2) 


Calculating the Standard Deviation 


If x is a data value, then the difference "x - mean" is called its deviation. In a data set, there are as many 
deviations as there are items in the data set. The deviations are used to calculate the standard deviation. If the data 


is for a population, in symbols a deviation is z — wz. For sample data, in symbols a deviation is x— x . 


The procedure to calculate the standard deviation depends on whether the data is for the entire population or comes 
from a sample. The calculations are similar, but not identical. Therefore the symbol used to represent the standard 
deviation depends on whether it is a population or a sample. The lower case letter s represents the sample standard 
deviation and the Greek letter o (sigma, lower case) represents the population standard deviation. If the sample has 
the same characteristics as the population, then s should be a good estimate of oc. 


To calculate the standard deviation, we need to calculate the variance first. The variance is an average of the 
squares of the deviations (the x— x values for a sample, or the x — pu values for a population). The symbol o? 
represents the population variance; the population standard deviation a is the square root of the population 
variance. The symbol s” represents the sample variance; the sample standard deviation s is the square root of the 
sample variance. You can think of the standard deviation as a special average of the deviations. 


If the data is from a population, when we calculate the average of the squared deviations to find the variance, we 
divide by N, the number of items in the population. If the data is from a sample rather than a population, when we 
calculate the average of the squared deviations, we divide by n-1, one less than the number of items in the sample. 
You can see that in the formulas below. 

Formulas for Sample Standard Deviation 


= oar 2 
r= \/ Seat nea eS 


n-1 
e For the sample standard deviation, the denominator is n-1, that is the sample size MINUS 1. 


Formulas for Population Standard Deviation 


e For the population standard deviation, the denominator is N, the number of items in the population. 


In these fomulas, f represents the frequency with which a value appears. For example, if a value appears once, f is 
1. If a value appears three times in the data set, f is 3. 


Note: In practice, USE A CALCULATOR OR COMPUTER SOFTWARE TO CALCULATE THE 
STANDARD DEVIATION. If you are using a TI-83,83+,84+ calculator, you need to select the appropriate 
standard deviation o or s from the summary statistics. We will concentrate on using and interpreting the 
information that the standard deviation gives us. However you should study the following step-by-step example to 
help you understand how the standard deviation measures variation from the mean. 


Example: 

At an elementary school, a teacher was interested in the average age and the standard deviation of the ages of the 
students in the fifth grade. The following data are the ages for a SAMPLE of n=20 fifth grade students. The ages 
are rounded to the nearest half year: 

8) S15) SHS IO) 10) TO) TI) OSS) TO}! O15) Is) TL aL AL AGL aL TL TALS GL 55 1155 

Equation: 


9+9.5x2+10x4+4+10.5x4+4+11x6+411.5 x 3 
i 


= 10.525 
20 


The sample average age is 10.53 years, rounded to 2 places. 
The variance may be calculated by using a table. Then the standard deviation is calculated by taking the square 
root of the variance. We will explain the parts of the table after calculating s. 


Data Freq. Deviations Deviations? (Freq.)(Deviations’) 


x i (x — 2) (e— 2)’ (f)(e — 2)’ 

9 1 9 — 10.525 = —1.525 (—1.525)? = 2.325625 1 x 2.325625 = 2.325625 
9.5 2 9.5 — 10.525 = —1.025 (—1.025)? = 1.050625 2 x 1.050625 = 2.101250 
10 4 10 — 10.525 = —0.525 (—0.525)” = 0.275625 4 x .275625 = 1.1025 
10.5 4 10.5 — 10.525 = —0.025 (—0.025)” = 0.000625 4 x .000625 = .0025 

11 6 11 — 10.525 = 0.475 (0.475)? = 0.225625 6 xX .225625 = 1.35375 
11.5 3 11.5 — 10.525 = 0.975 (0.975)” = 0.950625 3 x .950625 = 2.851875 


The sample variance s” is equal to the sum of the last column (9.7375) divided by the total number of data 
values minus one (20 - 1): 

s? = SBP = 0.5125 

The sample standard deviation s is equal to the square root of the sample variance: 

s = 70.5125 = 0.715891 Rounded to two decimal places, s = 0.72 

Typically, you do the calculation for the standard deviation on a calculator or computer. Also note that we 
only rounded at the end of the calculation. The intermediate results are not rounded; this is done for accuracy. 
Exercise: 


Problem: Verify the mean and standard deviation calculated above using a calculator or computer. 
Solution: 


For the TI-83,83+,84+, enter data into the list editor. 

Put the data values in list L1 and the frequencies in list L2. 

STAT CALC 1-VarStats L1, L2 

x=10.525 

Use Sx because this is sample data (not a population): Sx=.715891 


For the following problems, recall that value = mean + (#ofSTDEVs)(standard deviation) 
For a sample: z = x + (#ofSTDEVs)(s) 

For a population: x = pz + (#ofSTDEVs)( oc) 

For this example, use x = x + (#ofSTDEVs)(s) because the data is from a sample 


Exercise: 


Problem: Find the value that is 1 standard deviation above the mean. Find (x + 1s). 


Solution: 


(x + 1s) = 10.53 + (1)(0.72) = 11.25 


Exercise: 


Problem: Find the value that is two standard deviations below the mean. Find (x — 2s). 


Solution: 


(x — 2s) = 10.53 — (2)(0.72) = 9.09 


Exercise: 


Problem: Find the values that are 1.5 standard deviations from (below and above) the mean. 


Solution: 


¢ (x —1.5s) = 10.53 — (1.5)(0.72) = 9.45 
° (« +1.5s) = 10.53 + (1.5)(0.72) = 11.61 


Explanation of the standard deviation calculation shown in the table 

The deviations show how spread out the data are about the mean. The data value 11.5 is farther from the mean than 
is the data value 11. The deviations 0.97 and 0.47 indicate that. A positive deviation occurs when the data value is 
greater than the mean. A negative deviation occurs when the data value is less than the mean; the deviation is 
-1.525 for the data value 9. If you add up all the deviations, the sum is always zero; the positive and negative 
deviations offset each other. (For this example, there are n=20 deviations.) So you cannot simply add the 
deviations to get the spread of the data. By squaring the deviations, they become positive numbers, and the sum 
will also be positive. The variance, then, is the average squared deviation. 


The variance is a squared measure and does not have the same units as the data. Taking the square root solves the 
problem. The standard deviation measures the spread in the same units as the data. 


Notice that instead of dividing by n=20, the calculation divided by n-1=20-1=19 because the data is a sample. For 
the sample variance, we divide by the sample size minus one (n-1). Why not divide by n? The answer has to do 
with the population variance. The sample variance is an estimate of the population variance. Based on the 
theoretical mathematics that lies behind these calculations, dividing by (n-1) gives a better estimate of the 
population variance. 


Note: Your concentration should be on what the standard deviation tells us about the data. The standard deviation 
is a number which measures how far the data are spread from the mean. Let a calculator or computer do the 
arithmetic. 


The standard deviation, s or a, is either zero or larger than zero. When the standard deviation is 0, there is no 
spread; that is, the all the data values are equal to each other. The standard deviation is small when the data are all 
concentrated close to the mean, and is larger when the data values show more variation from the mean. When the 
standard deviation is a lot larger than zero, the data values are very spread out about the mean; outliers can make s 
or o very large. 


The standard deviation, when first presented, can seem unclear. By graphing your data, you can get a better "feel" 
for the deviations and the standard deviation. You will find that in symmetrical distributions, the standard deviation 
can be very helpful but in skewed distributions, the standard deviation may not be much help. The reason is that 
the two sides of a skewed distribution have different spreads. In a skewed distribution, it is better to look at the 
first quartile, the median, the third quartile, the smallest value, and the largest value. Because numbers can be 
confusing, always graph your data. 


Example: 
Exercise: 


Problem: Use the following data (first exam scores) from Susan Dean's spring pre-calculus class: 
3342494953555561 6367686869697273 7478808388888890 929494949496100 


e aCreate a chart containing the data, frequencies, relative frequencies, and cumulative relative 
frequencies to three decimal places. 
e bCalculate the following to one decimal place using a TI-83+ or TI-84 calculator: 


iThe sample mean 

iiThe sample standard deviation 
iiiThe median 

ivThe first quartile 

vthe third quartile 

vilQR 


Oe Cn Om OnsOmmnO) 


e cConstruct a box plot and a histogram on the same set of axes. Make comments about the box plot, the 
histogram, and the chart. 


Solution: 
ea 

Data Frequency Relative Frequency Cumulative Relative Frequency 
38) 1 0.032 0.032 
42 il 0.032 0.064 
49 2 0.065 0.129 
53 il 0.032 0.161 
5D) 2 0.065 0.226 
61 il 0.032 0.258 
63 1 0.032 0.29 
67 il 0.032 0.322 
68 2 0.065 0.387 
69 2 0.065 0.452 
72 1 0.032 0.484 


73 1 0.032 0.516 


Data Frequency Relative Frequency Cumulative Relative Frequency 


74 1 0.032 0.548 

78 1 0.032 0.580 

80 1 0.032 0.612 

83 il 0.032 0.644 

88 3 0.097 0.741 

90 1 0.032 0.773 

92 il 0.032 0.805 

94 4 Ong) 0.934 

96 il 0.032 0.966 

100 1 0.032 0.998 (Why isn't this value 1?) 
eb 

o iThe sample mean = 73.5 

o iiThe sample standard deviation = 17.9 

o iiiThe median = 73 

© ivThe first quartile = 61 

o vtThe third quartile = 90 

© vilIQR = 90 - 61 = 29 


e cThe x-axis goes from 32.5 to 100.5; y-axis goes from -2.4 to 15 for the histogram; number of intervals 
is 5 for the histogram so the width of an interval is (100.5 - 32.5) divided by 5 which is equal to 13.6. 
Endpoints of the intervals: starting point is 32.5, 32.5+13.6 = 46.1, 46.1+13.6 = 59.7, 59.7+13.6 = 73.3, 
73.3+13.6 = 86.9, 86.9+13.6 = 100.5 = the ending value; No data values fall on an interval boundary. 


The long left whisker in the box plot is reflected in the left side of the histogram. The spread of the exam 
scores in the lower 50% is greater (73-33=40) than the spread in the upper 50% (100-73=27). The histogram, 
box plot, and chart all reflect this. There are a substantial number of A and B grades (80s, 90s, and 100). The 
histogram clearly shows this. The box plot shows us that the middle 50% of the exam scores (IQR=29) are 
Ds, Cs, and Bs. The box plot also shows us that the lower 25% of the exam scores are Ds and Fs. 


Comparing Values from Different Data Sets 
The standard deviation is useful when comparing data values that come from different data sets. If the data sets 
have different means and standard deviations, it can be misleading to compare the data values directly. 


e For each data value, calculate how many standard deviations the value is away from its mean. 
e Use the formula: value = mean + (#ofSTDEVs)(standard deviation); solve for #ofSTDEVs. 
. #ofSTDEVs = value—mean 


standard deviation 
e Compare the results of this calculation. 


#ofSTDEVs is often called a "z-score"; we can use the symbol z. In symbols, the formulas become: 


= — &£-2z 
Sample L=XL+ZS er 
+ = _ &a-p 
Population L=put+zo z= 
Example: 
Exercise: 
Problem: 


Two students, John and Ali, from different high schools, wanted to find out who had the highest grade point 
average (GPA) when compared to his school. Which student had the highest GPA when compared to his 
school? 


Student GPA School Mean GPA School Standard Deviation 
John 2.85 3.0 0.7 
Ali 77 80 10 

Solution: 


For each student, determine how many standard deviations (#ofSTDEVs) his GPA is away from the average, 
for his school. Pay careful attention to signs when comparing and interpreting the answer. 


#ofSTDEVs = value—mean [2= tp 


standard deviation o 


For John, z = #ofSTDEVs = 23-3° — —0,21 


ForAl, 7— 401s 1 DEVs— —2 9.3 


John has the better GPA when compared to his school because his GPA is 0.21 standard deviations below his 
mean while Ali's GPA is 0.3 standard deviations below his mean. 


John's z-score of —0.21 is higher than Ali's z-score of —0.3 . For GPA, higher values are better, so we 
conclude that John has the better GPA when compared to his school. 


The following lists give a few facts that provide a little more insight into what the standard deviation tells us about 
the distribution of the data. 
For ANY data set, no matter what shape the distribution of the data is: 


e At least 75% of the data is within 2 standard deviations of the mean. 

e At least 89% of the data is within 3 standard deviations of the mean. 

e At least 95% of the data is within 4 1/2 standard deviations of the mean. 
e This is known as Chebyshev's Rule. 


For data having a distribution that is MOUND-SHAPED and SYMMETRIC: 


e Approximately 68% of the data is within 1 standard deviation of the mean. 

e Approximately 95% of the data is within 2 standard deviations of the mean. 

¢ More than 99% of the data is within 3 standard deviation of the mean. 

e This is known as the Empirical Rule. 

e It is important to note that this rule only applies when the shape of the distribution of the data is mound- 
shaped and symmetric. We will learn more about this when studying the "Normal" or "Gaussian" probability 
distribution in later chapters. 


Glossary 


Standard Deviation 
A number that is equal to the square root of the variance and measures how far data values are from their 
mean. Notations: s for sample standard deviation and ofor population standard deviation. 


Variance 
Mean of the squared deviations from the mean. Square of the standard deviation. 


Summary of Formulas 
A summary of useful formulas used in examining descriptive statistics 
Commonly Used Symbols 


e The symbol »’ means to add or to find the sum. 

e n= the number of data values in a sample 

e N =the number of people, things, etc. in the population 
e «x =the sample mean 

e s =the sample standard deviation 

e y= the population mean 

e o =the population standard deviation 

e f = frequency 

e x = numerical value 


Commonly Used Expressions 


e «*f =A value multiplied by its respective frequency 

e \\ a = The sum of the values 

e \\a*f = The sum of values multiplied by their respective frequencies 

e (x — x) or (x — p) = Deviations from the mean (how far a value is 
from the mean) 

e (x — x)” or (x — p)” = Deviations squared 


f(x - a)? or f(x — py)? = The deviations squared and multiplied by 
their frequencies 


Mean Formulas: 


° 2 =2t or x = aft 
de Life 


Standard Deviation Formulas: 


Formulas Relating a Value, the Mean, and the Standard Deviation: 


e value = mean + (#ofSTDEVs)(standard deviation), where #ofSTDEVs 
= the number of standard deviations 

e x = x£+ (HofSTDEVs)(s) 

e x = p+ (#ofSTDEVs)(oc) 


Practice 1: Center of the Data 

This module provides students with opportunities to apply concepts related 
to descriptive statistics. Students are asked to take a set of sample data and 
calculate a series of statistical values for that data. 


Student Learning Outcomes 


e The student will calculate and interpret the center, spread, and location 
of the data. 
e The student will construct and interpret histograms an box plots. 


Given 


Sixty-five randomly selected car salespersons were asked the number of 
cars they generally sell in one week. Fourteen people answered that they 
generally sell three cars; nineteen generally sell four cars; twelve generally 
sell five cars; nine generally sell six cars; eleven generally sell seven cars. 


Complete the Table 


Cumulative 
Data Value Relative Relative 
(# cars) Frequency Frequency Frequency 


Discussion Questions 


Exercise: 


Problem: What does the frequency column sum to? Why? 


Solution: 
65 


Exercise: 


Problem: What does the relative frequency column sum to? Why? 


Solution: 


1 
Exercise: 


Problem: 


What is the difference between relative frequency and frequency for 
each data value? 


Exercise: 


Problem: 


What is the difference between cumulative relative frequency and 
relative frequency for each data value? 


Enter the Data 


Enter your data into your calculator or computer. 


Construct a Histogram 


Determine appropriate minimum and maximum x and y values and the 
scaling. Sketch the histogram below. Label the horizontal and vertical axes 
with words. Include numerical scaling. 


Data Statistics 


Calculate the following values: 
Exercise: 


Problem: Sample mean = x = 


Solution: 


4.75 


Exercise: 


Problem: Sample standard deviation = s, = 


Solution: 


1.39 


Exercise: 


Problem: Sample size = n = 


Solution: 


65 


Calculations 


Use the table in section 2.11.3 to calculate the following values: 
Exercise: 


Problem: Median = 


Solution: 
4 
Exercise: 


Problem: Mode = 


Solution: 
4 
Exercise: 


Problem: First quartile = 


Solution: 
4 
Exercise: 


Problem: Second quartile = median = 50th percentile = 


Solution: 


4 


Exercise: 


Problem: Third quartile = 


Solution: 
6 


Exercise: 


Problem: Interquartile range (IQR) = en 
Solution: 
6—4=2 

Exercise: 


Problem: 10th percentile = 


Solution: 
3 
Exercise: 


Problem: 70th percentile = 

Solution: 

6 

Exercise: 

Problem: Find the value that is 3 standard deviations: 
e aAbove the mean 
e bBelow the mean 

Solution: 


e a8.93 


e b0.58 


Box Plot 


Construct a box plot below. Use a ruler to measure and scale accurately. 


Interpretation 


Looking at your box plot, does it appear that the data are concentrated 
together, spread out evenly, or concentrated in some areas, but not in 
others? How can you tell? 


Practice 2: Spread of the Data 
Practice exercise for Descriptive Statistics 


Student Learning Outcomes 


e The student will calculate measures of the center of the data. 
e The student will calculate the spread of the data. 


Given 


The population parameters below describe the full-time equivalent number of 
students (FTES) each year at Lake Tahoe Community College from 1976-77 
through 2004-2005. (Source: Graphically Speaking by Bill King, LTCC 
Institutional Research, December 2005). 


Use these values to answer the following questions: 


e «= 1000 FTES 

¢ Median = 1014 FTES 

e g =474FTES 

e First quartile = 528.5 FTES 

e Third quartile = 1447.5 FTES 
e n= 29 years 


Calculate the Values 


Exercise: 


Problem: 


A sample of 11 years is taken. About how many are expected to have a 
FTES of 1014 or above? Explain how you determined your answer. 


Solution: 


6 


Exercise: 


Problem: 75% of all years have a FTES: 
e aAt or below: 
e bAt or above: 

Solution: 


e al447.5 
¢ b528.5 


Exercise: 


Problem: The population standard deviation = 


Solution: 


474 FTES 
Exercise: 


Problem: 


What percent of the FTES were from 528.5 to 1447.5? How do you 
know? 


Solution: 
50% 
Exercise: 
Problem: What is the IQR? What does the IQR represent? 
Solution: 


319 


Exercise: 


Problem: 
How many standard deviations away from the mean is the median? 
Solution: 


0.03 


Additional Information: The population FTES for 2005-2006 through 2010- 
2011 was given in an updated report. (Source: 
http://www.ltcc.edu/data/ResourcePDF/LTCC_FactBook_2010-11.pdf). The 
data are reported here. 


2005- 2006- 2007- 2008- 2009- 2010- 


xear 06 07 08 09 10 14 
Total 1585 1690 1735 1935 2021 1890 
FTES 

Exercise: 
Problem: 


Calculate the mean, median, standard deviation, first quartile, the third 
quartile and the IQR. Round to one decimal place. 


Solution: 


mean = 1809.3 

median = 1812.5 

standard deviation = 151.2 
First quartile = 1690 


Third quartile = 1935 
TQR = 245 


Exercise: 
Problem: 
Construct a boxplot for the FTES for 2005-2006 through 2010-2011 and 
a boxplot for the FTES for 1976-1977 through 2004-2005. 
Exercise: 
Problem: 
Compare the IQR for the FTES for 1976-77 through 2004-2005 with the 


IQR for the FTES for 2005-2006 through 2010-2011. Why do you 
suppose the IQRs are so different? 


Solution: 


Hint: Think about the number of years covered by each time period and 
what happened to higher education during those periods. 


Descriptive Statistics: Practice 3: Interpreting Percentiles 


Interpreting Percentiles, Quartiles, and Median 

A percentile indicates the relative standing of a data value when data are 
sorted into numerical order, from smallest to largest. p% of data values are 
less than or equal to the pth percentile. 


e Low percentiles always correspond to lower data values. 
e High percentiles always correspond to higher data values. 


A percentile may or may not correspond to a value judgment about whether 
it is "good" or "bad". The interpretation of whether a certain percentile is 
good or bad depends on the context of the situation to which the data 
applies. In some situations, a low percentile would be considered "good'; in 
other contexts a high percentile might be considered "good". In many 
situations, there is no value judgment that applies. 


Understanding how to properly interpret percentiles is important not only 
when describing data, but is also important in later chapters of this textbook 
when calculating probabilities. 


Guideline: 
When writing the interpretation of a percentile in the context of the given 
data, the sentence should contain the following information: 


e information about the context of the situation being considered, 

e the data value (value of the variable) that represents the percentile, 

e the percent of individuals or items with data values below the 
percentile. 

e Additionally, you may also choose to state the percent of individuals or 
items with data values above the percentile. 


Example: 
On a timed math test, the first quartile for times for finishing the exam was 
35 minutes. Interpret the first quartile in the context of this situation. 


e 25% of students finished the exam in 35 minutes or less. 

e 75% of students finished the exam in 35 minutes or more. 

e A low percentile would be considered good, as finishing more quickly 
on a timed exam is desirable. (If you take too long, you might not be 
able to finish.) 


Example: 

On a 20 question math test, the 70th percentile for number of correct 
answers was 16. Interpret the 70th percentile in the context of this 
situation. 


¢ 70% of students answered 16 or fewer questions correctly. 

¢ 30% of students answered 16 or more questions correctly. 

¢ Note: A high percentile would be considered good, as answering more 
questions correctly is desirable. 


Example: 

At a certain community college, it was found that the 30th percentile of 
credit units that students are enrolled for is 7 units. Interpret the 30th 
percentile in the context of this situation. 


e 30% of students are enrolled in 7 or fewer credit units 

e 70% of students are enrolled in 7 or more credit units 

e In this example, there is no "good" or "bad" value judgment 
associated with a higher or lower percentile. Students attend 
community college for varied reasons and needs, and their course load 
varies according to their needs. 


Do the following Practice Problems for Interpreting Percentiles 


Exercise: 


Problem: 


e a For runners ina race, a low time means a faster run. The 
winners in a race have the shortest running times. Is it more 
desirable to have a finish time with a high or a low percentile 
when running a race? 

¢ b The 20th percentile of run times in a particular race is 5.2 
minutes. Write a sentence interpreting the 20th percentile in the 
context of the situation. 

e cA bicyclist in the 90th percentile of a bicycle race between two 
towns completed the race in 1 hour and 12 minutes. Is he among 
the fastest or slowest cyclists in the race? Write a sentence 
interpreting the 90th percentile in the context of the situation. 


Solution: 


e a For runners in a race it is more desirable to have a low 
percentile for finish time. A low percentile means a short time, 
which is faster. 

e bINTERPRETATION: 20% of runners finished the race in 5.2 
minutes or less. 80% of runners finished the race in 5.2 minutes 
or longer. 

¢ cHe is among the slowest cyclists (90% of cyclists were faster 
than him.) INTERPRETATION: 90% of cyclists had a finish time 
of 1 hour, 12 minutes or less.Only 10% of cyclists had a finish 
time of 1 hour, 12 minutes or longer 


Exercise: 
Problem: 
e a For runners in a race, a higher speed means a faster run. Is it 


more desirable to have a speed with a high or a low percentile 
when running a race? 


e bThe 40th percentile of speeds in a particular race is 7.5 miles per 
hour. Write a sentence interpreting the 40th percentile in the 
context of the situation. 


Solution: 


e aFor runners in a race it is more desirable to have a high 
percentile for speed. A high percentile means a higher speed, 
which is faster. 

e¢ bINTERPRETATION: 40% of runners ran at speeds of 7.5 miles 
per hour or less (slower). 60% of runners ran at speeds of 7.5 
miles per hour or more (faster). 


Exercise: 
Problem: 


On an exam, would it be more desirable to earn a grade with a high or 
low percentile? Explain. 


Solution: 
On an exam you would prefer a high percentile; higher percentiles 
correspond to higher grades on the exam. 

Exercise: 
Problem: 
Mina is waiting in line at the Department of Motor Vehicles (DMV). 
Her wait time of 32 minutes is the 85th percentile of wait times. Is that 


good or bad? Write a sentence interpreting the 85th percentile in the 
context of this situation. 


Solution: 


When waiting in line at the DMV, the 85th percentile would be a long 
wait time compared to the other people waiting. 85% of people had 


shorter wait times than you did. In this context, you would prefer a 
wait time corresponding to a lower percentile. INTERPRETATION: 
85% of people at the DMV waited 32 minutes or less. 15% of people 
at the DMV waited 32 minutes or longer. 


Exercise: 


Problem: 


In a survey collecting data about the salaries earned by recent college 
graduates, Li found that her salary was in the 78th percentile. Should 
Li be pleased or upset by this result? Explain. 


Solution: 


Li should be pleased. Her salary is relatively high compared to other 
recent college grads. 78% of recent college graduates earn less than Li 
does. 22% of recent college graduates earn more than Li does. 


Exercise: 


Problem: 


In a study collecting data about the repair costs of damage to 
automobiles in a certain type of crash tests, a certain model of car had 
$1700 in damage and was in the 90th percentile. Should the 
manufacturer and/or a consumer be pleased or upset by this result? 
Explain. Write a sentence that interprets the 90th percentile in the 
context of this problem. 


Solution: 


The manufacturer and the consumer would be upset. This is a large 
repair cost for the damages, compared to the other cars in the sample. 
INTERPRETATION: 90% of the crash tested cars had damage repair 
costs of $1700 or less; only 10% had damage repair costs of $1700 or 
more. 


Exercise: 


Problem: 


e The University of California has two criteria used to set 
admission standards for freshman to be admitted to a college in 
the UC system: 

e a. Students' GPAs and scores on standardized tests (SATs and 
ACTs) are entered into a formula that calculates an "admissions 
index" score. The admissions index score is used to set eligibility 
standards intended to meet the goal of admitting the top 12% of 
high school students in the state. In this context, what percentile 
does the top 12% represent? 

e b. Students whose GPAs are at or above the 96th percentile of all 
students at their high school are eligible (called eligible in the 
local context), even if they are not in the top 12% of all students 
in the state. What percent of students from each high school are 
"eligible in the local context"? 


Solution: 


e aThe top 12% of students are those who are at or above the 88th 
percentile of admissions index scores. 

¢ b The top 4% of students' GPAs are at or above the 96th 
percentile, making the top 4% of students "eligible in the local 
context". 


Exercise: 


Problem: 


Suppose that you are buying a house. You and your realtor have 
determined that the most expensive house you can afford is the 34th 
percentile. The 34th percentile of housing prices is $240,000 in the 
town you want to move to. In this town, can you afford 34% of the 
houses or 66% of the houses? 


Solution: 


You can afford 34% of houses. 66% of the houses are too expensive 
for your budget. INTERPRETATION: 34% of houses cost $240,000 or 


less. 66% of houses cost $240,000 or more. 


Descriptive Statistics Homework Link (Collaborative Statistics; R. Bloom 
custom version) 


Link to homework questions in Homework Collection/Book for Descriptive 
Statistics Chapter 2 of Collaborative Statistics for R. Bloom 


Probability Topics 
This module introduces the concept of Probability, the chance of an event 
occurring. 


Student Learning Outcomes 
By the end of this chapter, the student should be able to: 


e Understand and use the terminology of probability. 

e Determine whether two events are mutually exclusive and whether two 
events are independent. 

¢ Calculate probabilities using the Addition Rules and Multiplication 
Rules. 

e Construct and interpret Contingency Tables. 

e Construct and interpret Venn Diagrams (optional). 

e Construct and interpret Tree Diagrams (optional). 


Introduction 


It is often necessary to "guess" about the outcome of an event in order to 
make a decision. Politicians study polls to guess their likelihood of winning 
an election. Teachers choose a particular course of study based on what they 
think students can comprehend. Doctors choose the treatments needed for 
various diseases based on their assessment of likely results. You may have 
visited a casino where people play games chosen because of the belief that 
the likelihood of winning is good. You may have chosen your course of 
study based on the probable availability of jobs. 


You have, more than likely, used probability. In fact, you probably have an 
intuitive sense of probability. Probability deals with the chance of an event 
occurring. Whenever you weigh the odds of whether or not to do your 
homework or to study for an exam, you are using probability. In this 
chapter, you will learn to solve probability problems using a systematic 
approach. 


Optional Collaborative Classroom Exercise 


Your instructor will survey your class. Count the number of students in the 
class today. 


e Raise your hand if you have any change in your pocket or purse. 
Record the number of raised hands. 

e Raise your hand if you rode a bus within the past month. Record the 
number of raised hands. 

e Raise your hand if you answered "yes" to BOTH of the first two 
questions. Record the number of raised hands. 


Use the class data as estimates of the following probabilities. P(change) 
means the probability that a randomly chosen person in your class has 
change in his/her pocket or purse. P(bus) means the probability that a 
randomly chosen person in your class rode a bus within the last month and 
so on. Discuss your answers. 


e Find P(change). 

e Find P(bus). 

e Find P(change and bus) Find the probability that a randomly chosen 
student in your class has change in his/her pocket or purse and rode a 
bus within the last month. 

e Find P(change| bus) Find the probability that a randomly chosen 
student has change given that he/she rode a bus within the last month. 
Count all the students that rode a bus. From the group of students who 
rode a bus, count those who have change. The probability is equal to 
those who have change and rode a bus divided by those who rode a 
bus. 


Probability Topics: Terminology (modified R. Bloom) 


Probability measures the uncertainty that is associated with the outcomes of 
a particular experiment or activity. An experiment is a planned operation 
carried out under controlled conditions. If the result is not predetermined, 
then the experiment is said to be a chance experiment. Flipping one fair 
coin is an example of an experiment. 


The result of an experiment is called an outcome. A sample space is a set 
of all possible outcomes. Three ways to represent a sample space are to list 
the possible outcomes, to create a tree diagram, or to create a Venn diagram. 
The uppercase letter S' is used to denote the sample space. For example, if 
you flip one fair coin, S = {H, T} where H = heads and T = tails are the 
outcomes. 


An event is any combination of outcomes. Upper case letters like A and B 
represent events. For example, if the experiment is to flip one fair coin, 
event A might be getting at most one head. The probability of an event A is 
written P(A). 


The probability of any outcome is the long-term relative frequency of 
that outcome. Probabilities are between 0 and 1, inclusive (includes 0 and 
1 and all numbers between these values). P(A) = 0 means the event A can 
never happen. P(A) = 1 means the event A always happens. P(A) = 0.5 
means the event A is equally likely to occur or not to occur. For example, if 
you flip one fair coin repeatedly (from 20 to 2,000 to 20,000 times) the 
relative fequency of heads approaches 0.5 (the probability of heads). 


Equally likely means that each outcome of an experiment occurs with 
equal probability. For example, if you toss a fair, six-sided die, each face 
(1, 2, 3, 4, 5, or 6) is as likely to occur as any other face. If you toss a fair 
coin, a Head(H) and a Tail(T) are equally likely to occur. If you randomly 
guess the answer to a true/false question on an exam, you are equally likely 
to select a correct answer or an incorrect answer. 


To calculate the probability of an event A when all outcomes in the 
sample space are equally likely, count the number of outcomes for event 
A and divide by the total number of outcomes in the sample space. For 


example, if you toss a fair dime and a fair nickel, the sample space is 
{HH, TH, HT, TT} where T = tails and H = heads. The sample space 
has four outcomes. A = getting one head. There are two outcomes 

{HT, TH}. P(A) =2. 
Suppose you roll one fair six-sided die, with the numbers {1,2,3,4,5,6} on 
its faces. Let event & = rolling a number that is at least 5. There are two 
outcomes {5, 6}. P(E) =. If you were to roll the die only a few times, 


you would not be surprised if your observed results did not match the 
probability. If you were to roll the die a very large number of times, you 
would expect that, overall, 2/6 of the rolls would result an outcome of "at 
least 5". The long-term relative frequency of obtaining this result would 
approach the theoretical probability of 2/6 as the number of repetitions 
grows larger and larger. 


This important characteristic of probability experiments is the known as the 
Law of Large Numbers: as the number of repetitions of an experiment is 
increased, the relative frequency obtained in the experiment tends to 
become closer and closer to the theoretical probability. Even though the 
outcomes don't happen according to any set pattern or order, overall, the 
long-term observed relative frequency will approach the theoretical 
probability. (The word empirical is often used instead of the word 
observed.) The Law of Large Numbers will be discussed again in Chapter 7. 


It is important to realize that in many situations, the outcomes are not 
equally likely. A coin or die may be unfair, or biased . Two math 
professors in Europe had their statistics students test the Belgian 1 Euro 
coin and discovered that in 250 trials, a head was obtained 56% of the time 
and a tail was obtained 44% of the time. The data seem to show that the 
coin is not a fair coin; more repetitions would be helpful to draw a more 
accurate conclusion about such bias. Some dice may be biased. Look at the 
dice in a game you have at home; the spots on each face are usually small 
holes carved out and then painted to make the spots visible. Your dice may 
or may not be biased; it is possible that the outcomes may be affected by the 
slight weight differences due to the different numbers of holes in the faces. 
Gambling casinos have a lot of money depending on outcomes from rolling 
dice, so casino dice are made differently to eliminate bias. Casino dice have 


flat faces; the holes are completely filled with paint having the same density 
as the material that the dice are made out of so that each face is equally 
likely to occur. Later in this chapter we will learn techniques to use to work 
with probabilities for events that are not equally likely. 


"OR" Event: An outcome is in the event A OR Bif the outcome is in A 
or is in B or is in both A and B. For example, let A = {1, 2, 3, 4, 5} and 
B= {4,5,6, 7,8}. A OR B = (1, 2, 3, 4, 5, 6, 7, 8}. Notice that 4 
and 5 are NOT listed twice. 


"AND" Event: An outcome is in the event A AND B if the outcome is in 
both A and B at the same time. For example, let A and B be {1, 2, 3, 4, 5} 
and {4, 5, 6, 7, 8}, respectively. Then A AND B = {4,5}. 


The complement of event A is denoted A’ (read "A prime"). A’ consists of 
all outcomes that are NOT in A. Notice that P(A) + P(A’) = 1. For 
example, let S = {1, 2, 3, 4, 5, 6} and let A = {1, 2, 3, 4}. Then, 

A’ = {5, 6}. P(A) =4, P(A’) =2, and P(A) + P(A’) =4+2=1 
The conditional probability of A given B is written P(A|B). The 
probability of A is calculated knowing that B has already occurred. A 
conditional reduces the sample space. We calculate the probability of A 
from the reduced sample space B. The formula to calculate P(A|B) is 


P(A|B)= SST aae B) 


where P(B) is greater than 0. 


For example, suppose we toss one fair, six-sided die. The sample space 

S = {1, 2, 3, 4, 5, 6}. Let A = face is 2 or 3 and B = face is even (2, 4, 6). 
To calculate P(A|B), we count the number of outcomes 2 or 3 in the 
sample space B = {2, 4, 6}. Then we divide that by the number of 
outcomes in B (and not S). 


We get the same result by using the formula. Remember that S has 6 
outcomes. 


P(A|B) = 


P(A andB) _ (the number of outcomes that are 2 or 3andeveninS)/6 1/6 1 
P(B) 


(the number of outcomes that are even in S) / 6 ~ 3/6 3 


Understanding Terminology and Symbols 

It is important to read each problem carefully to think about and understand 
what the events are. Understanding the wording is the first very important 
step in solving probability problems. Reread the problem several times if 
necessary. Clearly identify the event of interest. Determine whether there is 
a condition stated in the wording that would indicate that the probability is 
conditional; carefully identify the condition, if any. 

Exercise: 


Problem: 


In a particular college class, there are male and female students. Some 
students have long hair and some students have short hair. Write the 
symbols for the probabilities of the events f or parts (a) through (j) 
below. (Note that you can't find numerical answers here. You were not 
given enough information to find any probability values yet; 
concentrate on understanding the symbols.) 


Let F be the event that a student is female. 

Let M be the event that a student is male. 

Let S be the event that a student has short hair. 
Let L be the event that a student has long hair. 


a The probability that a student does not have long hair. 

b The probability that a student is male or has short hair. 

c The probability that a student is a female and has long hair. 

d The probability that a student is male, given that the student has 
long hair. 

e The probability that a student is has long hair, given that the 
student is male. 

f Of all the female students, the probability that a student has 
short hair. 

g Of all students with long hair, the probability that a student is 
female. 

h The probability that a student is female or has long hair. 


e i The probability that a randomly selected student is a male 
student with short hair. 
e j The probability that a student is female. 


Solution: 


e a P(L')=P(S) 
¢ bP(MorS) 
e c P(F and L) 
e d P(MIL) 

e e P(L|M) 

e f P(S|F) 

° g P(FIL) 

e h P(F or L) 
e i P(M andS) 
sare 


Glossary 


Conditional Probability 
The likelihood that an event will occur given that another event has 
already occurred. 


Equally Likely 
Each outcome of an experiment has the same probability. 


Experiment 
A planned activity carried out under controlled conditions. 


Event 
A subset in the set of all outcomes of an experiment. The set of all 
outcomes of an experiment is called a sample space and denoted, as a 
rule, by S. An event is any arbitrary subset in S: it can contain one 
outcome, two outcomes, and even no outcomes (empty subset) or all of 


them (sample space). Standard notations for events are capital letters 
such as A, B, C, etc. 


Outcome (observation) 
A particular result of an experiment. 


Probability 
A number between 0 and 1, inclusive, that gives the likelihood that a 
specific event will occur. More exact, the foundation of statistics are 
given by the following 3 axioms (by A. N. Kolmogorov, 1930’s): Let 
S denote the sample space, A and B are any two events in S . Then: 
(1).0 < P(A) < 1; (2). If A and B are any two mutually exclusive 
events, then P(A or B) = P(A) + P(B); (3). P(S) =1. 


Sample Space 
The set of all possible outcomes of an experiment. 


Probability Topics: Independent & Mutually Exclusive Events (modified R. 
Bloom) 


Independent Events 


Two events are independent if the following are true: 


* P(A|B) = P(A) 


If events A and B are independent, then the chance of A occurring does 
not affect the chance of B occurring and vice versa. 


Translating the symbols into words, the first two mathematical statements 
listed above say that the probability for the event with the condition is the 
same as the probability for the event without the condition. For independent 
events: the condition does not change the probability for the event. 


For example, two roles of a fair die are independent events. The outcome 
of the first roll does not change the probability for the outcome of the 
second roll. 


If you select 2 cards consecutively from a complete deck of playing cards, 
the two selections are not independent; the result of the first selection 
changes the remaining deck and affects the probabilities for the second 
selection. This is referred to as selecting "without replacement"; the first 
card has not been replaced into the deck before the second card is selected. 


However, suppose you were to select 2 cards "with replacement", by 
returning your first card to the deck and shuffling the deck before selecting 
the second card. Because the deck of cards is complete for both selections, 
the first selection does not affect the probability of the second selection. 
When selecting cards with replacement, the selections are independent. 


To show that two events are independent, you must show only one of the 
conditions listed above. If any one of these conditions is true, then all of 


them are true. 


Mutually Exclusive Events 


Events A and B are mutually exclusive events if they cannot occur at the 
same time. This means that A and B do not share any outcomes and 
P(A AND B) = 0. 


e For example, suppose the sample space 
5 ={1, 2,.3, 4, 5, 6, 7, 8, 9,10}. 

e Let A = {1, 2,3, 4,5}, B = {4, 5, 6, 7, 8}, and C = {7, 9}. 

e A AND B = {4,5}. P(A AND B) = — and is not equal to zero. 
Therefore, A and B are not mutually exclusive. 

e A and C do not have any numbers in common so P(A AND C) = 0. 
Therefore, A and C are mutually exclusive. 


Note:Independent and mutually exclusive do not mean the same thing. 


You must show that any two events are independent or mutually exclusive. 
You cannot assume either of these conditions. 


If it is not known whether A and B are independent or dependent, assume 
they are dependent until you can show otherwise. 


The following examples illustrate these definitions and terms. 


Example: 

Flip two fair coins. (This is an experiment.) 

The sample space is {HH, HT, TH, TT} where T = tails and H = heads. 
The outcomes are HH, HT, TH, and TT. The outcomes HT and TH are 
different. The HT means that the first coin showed heads and the second 


coin showed tails. The TH means that the first coin showed tails and the 
second coin showed heads. 


e Let A = the event of getting at most one tail. (At most one tail means 
0 or 1 tail.) Then A can be written as {HH, HT, TH}. The outcome 
HH shows 0 tails. HT and TH each show 1 tail. 

¢ Let B = the event of getting all tails. B can be written as {TT}. B is 
the complement of A. So, B = A’. Also, 

P(A) + P(B) = P(A) + P(A’) = 1. 

e The probabilities for A and for B are P(A) = + and P(B) = i. 

e Let C = the event of getting all heads. C = {HH}. Since B = {TT}, 
P(B AND C) = 0. Band C are mutually exclusive. (B and C have 
no members in common because you cannot have all tails and all 
heads at the same time.) 

¢ Let D = event of getting more than one tail. D = {TT}. P(D) = 4 

¢ Let & = event of getting a head on the first roll. (This implies you can 
get either a head or tail on the second roll.) FE = {HT, HH}. 

P(E) = 2. 

e Find the probability of getting at least one (1 or 2) tail in two flips. 
Let F' = event of getting at least one tail in two flips. 


jee Wed Ws db Had AG eee 


Example: 

Roll one fair 6-sided die. The sample space is {1, 2, 3, 4, 5, 6}. Let event 
A =a face is odd. Then A = {1, 3, 5}. Let event B =a face is even. Then 
B = {2, 4, 6}. 


e Find the complement of A, A’. The complement of A, A’, is B 
because A and B together make up the sample space. 
P(A) + P(B) = P(A) + P(A’) = 1. Also, P(A) = 2 and 


=o 
P(B) = = 


¢ Let event C = odd faces larger than 2. Then C' = {3, 5}. Let event D 
= all even faces smaller than 5. Then D = {2,4}. P(C and D) = 0 
because you cannot have an odd and even face at the same time. 
Therefore, C' and D are mutually exclusive events. 

Let event E = all faces less than 5. H = {1, 2, 3, 4}. 

Exercise: 


Problem: 


Are C and FE mutually exclusive events? (Answer yes or no.) 
Why or why not? 


Solution: 


No. C = {3, 5} and E = {1, 2, 3, 4}. P(C AND E) = =. Tobe 
mutually exclusive, P(C AND E) must be 0. 


Find P(C|A). This is a conditional. Recall that the event C is {3, 5} 
and event A is {1, 3, 5}. To find P(C|A), find the probability of C 
using the sample space A. You have reduced the sample space from 
the original sample space {1, 2, 3, 4, 5, 6} to {1, 3, 5}. So, 

P(C|A) = = 


Example: 

Let event G = taking a math class. Let event H = taking a science class. 
Then, G AND H = taking a math class and a science class. Suppose 
P(G) = 0.6, P(H) = 0.5, and P(G AND H) = 0.3. Are G and H 
independent? 

If G and H are independent, then you must show ONE of the following: 


» P(G|H) = P(G) 


P(H|G) = P(H 
P(G AND H) = P(G)- P(H) 


Note:The choice you make depends on the information you have. You 
could choose any of the methods here because you have the necessary 
information. 


Exercise: 


Problem: Show that P(G|H) = P(G). 


Solution: 


P(G AND H 
P(G|H) = “Sa = 38 = 0.6 = PG) 


Exercise: 
Problem: Show P(G AND H) = P(G)- P(H). 


Solution: 


P(G)-P(H) = 0.6-0.5 = 0.3 = P(G AND H) 


Interpretation of results 

Since G and H are independent, then, knowing that a person is taking a 
science class does not change the chance that he/she is taking math. (Note: 
IF the two events had not been independent - that is, IF they were 
dependent - then knowing that a person is taking a science class would 
change the chance he/she is taking math. The next example will illustrate 
two events that are not independent.) 


Example: 

In a particular college class, 60% of the students are female. 50 % of all 
students in the class have long hair. 45% of the students are female and 
have long hair. Of the female students, 75% have long hair. Let F be the 


event that the student is female. Let L be the event that the student has long 
hair. Are the events of being female and having long hair independent? 


e The following probabilities are given in this example: 
ee P(E) = 0.60537 (a0; 50 

e P(F AND L) = 0.45 

e P(L|F) = 0.75 


If F and L are independent, then the following conditions are true. BUT if 
you show that any of the conditions are not true, then F and L are not 
independent. 


¢ P(L|F) = P(L) 
¢ P(F|L) = P(F) 
¢ P(F AND L) = P(F) - P(L) 


Note:The choice you make depends on the information you have. You 
could use the first or last condition on the list for this example. You do not 
know P(F|L) yet, so you can not use the second condition. 


Solution 1 

Check whether P(F and L) = P(F)P(L): We are given that P(F and L) = 0.45 
; but P(F)P(L) = (0.60)(0.50)= 0.30 The events of being female and having 
long hair are not independent because P(F and L) does not equal P(F)P(L). 
Solution 2 

Check whether P(L|F) equals P(L): We are given that P(L|F) = 0.75 but 
P(L) = 0.50; they are not equal. The events of being female and having 
long hair are not independent. 

Interpretation of results 

The events of being female and having long hair are not independent; 
knowing that a student is female changes the probability that a student has 
long hair. 


Example: 

In a box there are 3 red cards and 5 blue cards. The red cards are marked 
with the numbers 1, 2, and 3, and the blue cards are marked with the 
numbers 1, 2, 3, 4, and 5. The cards are well-shuffled. You reach into the 
box (you cannot see into it) and draw one card. 

Let R = red card is drawn, B = blue card is drawn, & = even-numbered 
card is drawn. 

The sample space S = R1, R2, R3, B1, B2, B3, B4, Bd. S has 8 
outcomes. 


P(R) = 2. P(B) = 2. P(R AND B) = 0. (You cannot draw one 
card that is both red and blue.) 

ie 3. (There are 3 even-numbered cards, R2, B2, and B4.) 
P(E|B) = 2. (There are 5 blue cards: B1, B2, B3, B4, and B5. Out 
of the blue cards, there are 2 even cards: B2 and B4.) 

PSE) - (There are 3 even-numbered cards: R2, B2, and B4. 
Out of the even-numbered cards, 2 are blue: B2 and B4.) 

The events R and B are mutually exclusive because 

P(R AND B) = 0. 

Let G = card with a number greater than 3. G = {B4, B5}. 

P(G) = <. Let H = blue card numbered between 1 and 4, inclusive. 
H = {B1, B2, B3, B4}. P(G|H) = 4. (The only card in H that has 
a number greater than 3 is B4.) Since = +, P(G) = P(G|H) 
which means that G and H are independent. 


Glossary 


Independent Events 
The occurrence of one event has no effect on the probability of the 
occurrence of any other event. Events A and B are independent if one 
of the following is true: (1). P(A|B) = P(A); (2) P(B|A) = P(B); 
(3) P(Aand B) = P(A)P(B). 


Mutually Exclusive 
An observation cannot fall into more than one class (category). Being 
in one category prevents being in a mutually exclusive category. 


Two Basic Rules of Probability 
This module introduces the multiplication and addition rules used when calculating 
probabilities. 


The Multiplication Rule 


If A and B are two events defined on a sample space, then: 
P(A AND B) = P(B)- P(A|B). 


This rule may also be written as : P(A|B)= ee ae 
(The probability of A given B equals the probability of A and B divided by the 
probability of B.) 


If A and B are independent, then P(A|B) = P(A). Then 
P(A AND B) = P(A|B) P(B) becomes P(A AND B) = P(A) P(B). 


The Addition Rule 


If A and B are defined on a sample space, then: 
P(A OR B) = P(A) + P(B) — P(A AND B). 


If A and B are mutually exclusive, then P(A AND B) = 0. Then 
P(A OR B) = P(A) + P(B) — P(A AND B) becomes 
P(A OR B) = P(A) + P(B). 


Example: 
Klaus is trying to choose where to go on vacation. His two choices are: A = New 
Zealand and B = Alaska 


¢ Klaus can only afford one vacation. The probability that he chooses A is 
P(A) = 0.6 and the probability that he chooses B is P(B) = 0.35. 

e P(A and B) = 0 because Klaus can only afford to take one vacation 

e Therefore, the probability that he chooses either New Zealand or Alaska is 
P(A OR B) = P(A) + P(B) = 0.6 + 0.35 = 0.95. Note that the probability 
that he does not choose to go anywhere on vacation must be 0.05. 


Example: 


Carlos plays college soccer. He makes a goal 65% of the time he shoots. Carlos is going 
to attempt two goals in a row in the next game. 

A = the event Carlos is successful on his first attempt. P(A) = 0.65. B = the event 
Carlos is successful on his second attempt. P(B) = 0.65. Carlos tends to shoot in 
streaks. The probability that he makes the second goal GIVEN that he made the first 
goal is 0.90. 

Exercise: 


Problem: What is the probability that he makes both goals? 


Solution: 


The problem is asking you to find P(A AND B) = P(B AND A). Since 
P(B|A) = 0.90: 
Equation: 


P(B AND A) = P(BJA) P(A) = 0.90*0.65 = 0.585 


Carlos makes the first and second goals with probability 0.585. 
Exercise: 


Problem: 
What is the probability that Carlos makes either the first goal or the second goal? 
Solution: 


The problem is asking you to find P(A OR B). 
Equation: 


P(A ORB) = P(A) + P(B) — P(A AND B) = 0.65 + 0.65 — 0.585 = 0.715 


Carlos makes either the first goal or the second goal with probability 0.715. 
Exercise: 


Problem: Are A and B independent? 


Solution: 


No, they are not, because P(B AND A) = 0.585. 
Equation: 


P(B) - P(A) = (0.65) - (0.65) = 0.423 
Equation: 


0.423 4 0.585 = P(B AND A) 


So, P(B AND A) is not equal to P(B) - P(A). 


Exercise: 


Problem: Are A and B mutually exclusive? 


Solution: 
No, they are not because P(A and B) = 0.585. 


To be mutually exclusive, P(A AND B) must equal 0. 


Example: 

A community swim team has 150 members. Seventy-five of the members are advanced 
swimmers. Forty-seven of the members are intermediate swimmers. The remainder are 
novice swimmers. Forty of the advanced swimmers practice 4 times a week. Thirty of 
the intermediate swimmers practice 4 times a week. Ten of the novice swimmers 
practice 4 times a week. Suppose one member of the swim team is randomly chosen. 
Answer the questions (Verify the answers): 

Exercise: 


Problem: What is the probability that the member is a novice swimmer? 


Solution: 


28 
150 


Exercise: 


Problem: What is the probability that the member practices 4 times a week? 


Solution: 


80 
150 


Exercise: 
Problem: 


What is the probability that the member is an advanced swimmer and practices 4 
times a week? 


Solution: 


40 
150 


Exercise: 
Problem: 
What is the probability that a member is an advanced swimmer and an 


intermediate swimmer? Are being an advanced swimmer and an intermediate 
swimmer mutually exclusive? Why or why not? 


Solution: 


P(advanced AND intermediate) = 0, so these are mutually exclusive events. 
A swimmer cannot be an advanced swimmer and an intermediate swimmer at the 
same time. 


Exercise: 


Problem: 


Are being a novice swimmer and practicing 4 times a week independent events? 
Why or why not? 


Solution: 


No, these are not independent events. 


Equation: 

P(novice AND practices 4 times per week) = 0.0667 
Equation: 

P(novice) - P(practices 4 times per week) = 0.0996 
Equation: 


0.0667 ¢ 0.0996 


Example: 

Studies show that, if she lives to be 90, about 1 woman in 7 (approximately 14.3%) will 
develop breast cancer. Suppose that of those women who develop breast cancer, a test is 
negative 2% of the time. Also suppose that in the general population of women, the test 
for breast cancer is negative about 85% of the time. Let B = woman develops breast 
cancer and let NV = tests negative. Suppose one woman is selected at random. 

Exercise: 


Problem: 


What is the probability that the woman develops breast cancer? What is the 
probability that woman tests negative? 


Solution: 


P= 0143 SPN) 0:85 
Exercise: 


Problem: 


Given that the woman has breast cancer, what is the probability that she tests 
negative? 


Solution: 


P(N|B) = 0.02 
Exercise: 


Problem: 
What is the probability that the woman has breast cancer AND tests negative? 
Solution: 


Pe AND N)— PB) PNB) = (0143) = (0:02) — 00029 
Exercise: 


Problem: 
What is the probability that the woman has breast cancer or tests negative? 


Solution: 


P(B ORN) = P(B) + P(N) — P(B AND N) = 0.143 + 0.85 — 0.0029 = 0.9901 


Exercise: 


Problem: Are having breast cancer and testing negative independent events? 


Solution: 


No. P(N) = 0.85; P(N|B) = 0.02. So, P(N|B) does not equal P(N) 


Exercise: 


Problem: Are having breast cancer and testing negative mutually exclusive? 


Solution: 


No. P(B AND N) = 0.0029. For B and N to be mutually exclusive, 
P(B AND N) must be 0. 


Glossary 


Independent Events 
The occurrence of one event has no effect on the probability of the occurrence of 
any other event. Events A and B are independent if one of the following is true: (1). 
P(A|B) = P(A); (2) P(B|A) = P(B); (3) P(Aand B) = P(A)P(B). 


Mutually Exclusive 
An observation cannot fall into more than one class (category). Being in more than 
one category prevents being in a mutually exclusive category. 


Sample Space 
The set of all possible outcomes of an experiment. 


Probability Topics: Contingency Tables (modified R. Bloom) 


A contingency table provides a different way of calculating probabilities. The table helps 
in determining conditional probabilities quite easily. The table displays sample values in 
relation to two different variables that may be dependent or contingent on one another. 
Later on, we will use contingency tables again, but in another manner. 


Example: 
Suppose a study of speeding violations and drivers who use car phones produced the 
following fictional data: 


Speeding violation in No speeding violation in 

the last year the last year Total 
Sau bHone 25 280 305 
user 
meeiesee 45 405 450 
phone user 
Total 70 685 755 


The total number of people in the sample is 755. The row totals are 305 and 450. The 
column totals are 70 and 685. Notice that 305 + 450 = 755 and 70 + 685 = 755. 
Calculate the following probabilities using the table 

Exercise: 


Problem: P(person is a car phone user) = 


Solution: 


number of car phone users __ 305 
total number in study —— 755 


Exercise: 


Problem: P(person had no violation in the last year) = 


Solution: 


number that had no violation __ 685 
total number in study 7 as 


Exercise: 


Problem: 


P(person had no violation in the last year AND was a car phone user) = 


Solution: 


Exercise: 


Problem: 


P(person is a car phone user OR person had no violation in the last year) = 


Solution: 


(208 + 82) 280 _ 710 


755 ' 755/755 755 


Exercise: 


Problem: 


P(person is a car phone user GIVEN person had a violation in the last year) = 
Solution: 


= (The sample space is reduced to the number of persons who had a violation.) 
Exercise: 


Problem: 


P(person had no violation last year GIVEN person was not a car phone user) = 


Solution: 


— (The sample space is reduced to the number of persons who were not car phone 


users. ) 


Example: 


The following table shows a random sample of 100 hikers and the areas of hiking 
preferred: 


The Near Lakes and On Mountain 
Sex Coastline Streams Peaks Total 
Female 18 16 ae 45 
Male — —_ 14 55 
Total Al 


Hiking Area Preference 


Exercise: 


Problem: Complete the table. 


Solution: 
The Near Lakes and On Mountain 
Sex Coastline Streams Peaks Total 
Female 18 16 11 45 
Male 16 25 14 55 
Total 34 41 25 100 


Hiking Area Preference 


Exercise: 


Problem: 
Are the events "being female" and "preferring the coastline" independent events? 
Let F = being female and let C= preferring the coastline. 


* aP(F AND C) = 
* bP(F) - P(C) = 


Are these two numbers the same? If they are, then F and C’ are independent. If they 
are not, then F’ and C are not independent. 


Solution: 
¢ aP(F AND C) = == =0.18 
¢ bP(F)-P(C) = a - = 0.45 - 0.45 = 0.153 


P(F AND C) #4 P(F) - P(C), so the events F and C are not independent. 
Exercise: 

Problem: 

Find the probability that a person is male given that the person prefers hiking near 


lakes and streams. Let M = being male and let L = prefers hiking near lakes and 
streams. 


e aWhat word tells you this is a conditional? 
¢ bFill in the blanks and calculate the probability: P(__|__) = 
e cls the sample space for this problem all 100 hikers? If not, what is it? 


Solution: 


e aThe word ‘given’ tells you that this is a conditional. 
¢ bP(M|L) = = 
e cNo, the sample space for this problem is 41. 


Exercise: 
Problem: 


Find the probability that a person is female or prefers hiking on mountain peaks. 
Let F = being female and let P = prefers mountain peaks. 


¢ cP(F AND P) = 


Solution 
¢ aP(F) = a 
° bP(P) = ito 
¢ cP(F AND P) = = 


ee) 25 iLike BY) 
o dE(h OR P) = ar jon 00 = ao 


Glossary 


Contingency Table 


The method of displaying a frequency distribution in case of dependable 


(contingent) variables; the table provides the easy way to calculate conditional 
probabilities. 


Venn Diagrams (optional) 

This module introduces Venn diagrams as a method for solving some probability 
problems. This module is included in the Elementary Statistics textbook/collection as an 
optional lesson. 


A Venn diagram is a picture that represents the outcomes of an experiment. It generally 
consists of a box that represents the sample space S together with circles or ovals. The 
circles or ovals represent events. 


Example: 

Suppose an experiment has the outcomes 1, 2, 3, ... , 12 where each outcome has an 
equal chance of occurring. Let event A = {1, 2, 3, 4, 5, 6} and event B = {6, 7, 8, 9}. 
Then A AND B = {6} and A ORB = (1, 2, 3, 4, 5, 6, 7, 8, 9}. The Venn diagram is 
as follows: 


Example: 

Flip 2 fair coins. Let A = tails on the first coin. Let B = tails on the second coin. Then 
A = {TT, TH} and B = {TT, HT}. Therefore, A AND B = {TT}. 

AOR Ss == sb Haan Han 

The sample space when you flip two fair coins is S = {HH, HT, TH, TT}. The 
outcome HH is in neither A nor B. The Venn diagram is as follows: 


S 


Example: 

Forty percent of the students at a local college belong to a club and 50% work part 
time. Five percent of the students work part time and belong to a club. Draw a Venn 
diagram showing the relationships. Let C’' = student belongs to a club and PT = student 
works part time. 


S 
C and PT 


_ «s 


If a student is selected at random find 


The probability that the student belongs to a club. P(C) = 0.40. 

The probability that the student works part time. P(PT) = 0.50. 

The probability that the student belongs to a club AND works part time. 

P(C AND PT) = 0.05. 

The probability that the student belongs to a club given that the student works part 
time. 

Equation: 


P(CIPT) = P(CANDPT) _ 0.05 _ 9, 
7 P(PT) — 0.50 °° 


The probability that the student belongs to a club OR works part time. 
Equation: 


P(C OR PT) = P(C) + P(PT) — P(C AND PT) = 0.40 + 0.50 — 0.05 = 0.85 


Glossary 


Venn Diagram 


The visual representation of a sample space and events in the form of circles or ovals 
showing their intersections. 


Tree Diagrams 

This module introduces tree diagrams as a method for making some probability 
problems easier to solve. This module is included in the Elementary Statistics 
textbook/collection as an optional lesson. 


A tree diagram is a special type of graph used to determine the outcomes of an 
experiment. It consists of "branches" that are labeled with either frequencies or 
probabilities. Tree diagrams can make some probability problems easier to visualize 
and solve. The following example illustrates how to use a tree diagram. 


Example: 

In an urn, there are 11 balls. Three balls are red (A) and 8 balls are blue (B). Draw 
two balls, one at a time, with replacement. "With replacement" means that you put 
the first ball back in the urn before you select the second ball. The tree diagram using 
frequencies that show all the possible outcomes follows. 


24BR 24RB 


Total = 64+ 24+ 244+ 9= 121 


The first set of branches represents the first draw. The second set of branches 
represents the second draw. Each of the outcomes is distinct. In fact, we can list each 
red ball as R1, R2, and R3 and each blue ball as B1, B2, B3, B4, B5, B6, B7, and 
B8. Then the 9 RR outcomes can be written as: 

R1R1 R1R2 R1R3 R2R1 R2R2 R2R3 R3R1 R3R2 R3R3 

The other outcomes are similar. 

There are a total of 11 balls in the urn. Draw two balls, one at a time, and with 
replacement. There are 11 - 11 = 121 outcomes, the size of the sample space. 
Exercise: 


Problem: List the 24 BR outcomes: B1R1, B1R2, B1R3, ... 
Solution: 
B1R1 B1R2 B1R3 B2R1 B2R2 B2R3 B3R1 B3R2 B3R3 B4R1 B4R2 


B4R3 B5R1 B5R2 B5R3 B6R1 B6R2 B6R3 B7R1 B7R2 B7R3 B&R1 
B8R2 B8&R3 


Exercise: 


Problem: Using the tree diagram, calculate P(RR). 
Solution: 


9 33 Oo — 


Exercise: 


Problem: Using the tree diagram, calculate P(RB OR BR). 


Solution: 


P(RBORBR)=2-4+2-4=2 
Exercise: 


Problem: 


Using the tree diagram, calculate P(R on 1st draw AND B on 2nd draw). 


Solution: 


P(R on 1st draw AND B on 2nd draw) = P(RB) = 4-4 = 


Exercise: 


Problem: 
Using the tree diagram, calculate P(R on 2nd draw given B on 1st draw). 
Solution: 


P(R on 2nd draw given B on Ist draw) = P(R on 2nd | Bon Ist) = 4 = 4 


This problem is a conditional. The sample space has been reduced to those 
outcomes that already have a blue on the first draw. There are 24 + 64 = 88 
possible outcomes Ce BR and 64 BB). Twenty-four of the 88 possible 


outcomes are BR. = = ea 


Exercise: 


Problem: Using the tree diagram, calculate P(BB). 


Solution: 

P(BB) = = 
Exercise: 

Problem: 


Using the tree diagram, calculate 
P(B on the 2nd draw given R on the first draw). 


Solution: 
P(B on 2nd draw | R on Ist draw) = -- 


There are 9 + 24 outcomes that have R on the first draw (9 RR and 24 RB). 
The sample space is then9 + 24 = 33. Twenty-four of the 33 outcomes have 
B on the second draw. The probability is then _ 


Example: 
An urn has 3 red marbles and 8 blue marbles in it. Draw two marbles, one at a time, 
this time without replacement from the urn. "Without replacement" means that you 
do not put the first ball back before you select the second ball. Below is a tree 
diagram. The branches are labeled with probabilities instead of frequencies. The 
numbers at the ends of the branches are ae by maui the numbers on the 
two corresponding branches, for example 


oa =o 


1* Draw 


56 24 24 6 
110 110 110 110 
BB BR RB RR 


Total — 26t24+24+6 _ 110 _ 4 


110 110 


Note:If you draw a red on the first draw from the 3 red possibilities, there are 2 red 
left to draw on the second draw. You do not put back or replace the first ball after 
you have drawn it. You draw without replacement, so that on the second draw there 
are 10 marbles left in the urn. 


Calculate the following probabilities using the tree diagram. 
Exercise: 


Problem: P(RR) = 


Solution: 
3 2 6 
P(RR) = 3 - ig = iw 
Exercise: 
Problem: Fill in the blanks: 


ELSE OUR IB) sec ape te (ae 


Solution: 


P(RB or BR) = 2. S+ 


pea 
[00 
— 
(=) 
= 
a 
i) 


Exercise: 


Problem: P(R on 2d | B on 1st) = 

Solution: 

P(R on 2d|Bonist) = 4 
Exercise: 

Problem: Fill in the blanks: 


P(R on 1st and B on 2nd) = P(RB) = (__)(__) = + 


110 
Solution: 
PR onl stands on2n0).— 9b RB) a & = 2. 
Exercise: 
Problem: P(BB) = 
Solution: 


P(BB) = = - + 


Exercise: 


Problem: P(B on 2nd | R on Ist) = 
Solution: 


There are 6 + 24 outcomes that have R on the first draw (6 RR and 24 RB). 


The 6 and the 24 are frequencies. They are also the numerators of the fractions 
acm and “. The sample space is no longer 110 but6 + 24 = 30. Twenty- 
four of the 30 outcomes have B on the second draw. The probability is then a. 


Did you get this answer? 


If we are using probabilities, we can label the tree in the following general way. 


PR and R)= P(RR) 


R on 2nd | R on 1st 
B on 2nd | R on 1st 
R on 2nd | B on 1st 
B on 2nd | B on 1st 


SS” 


) here means P 
) here means P 
) here means P 
) here means P 


EEN oN eae aa 
~=_—"{$" ~~” 


Glossary 


Sample Space 
The set of all possible outcomes of an experiment. 


Tree Diagram 
The useful visual representation of a sample space and events in the form of a 
“tree” with branches marked by possible outcomes simultaneously with 
associated probabilities (frequencies, relative frequencies). 


Summary of Formulas 

This module provides a review of the probability formulas, including the 
definitions of independent, complementary, and mutually exclusive events 
as well as the addition and multiplication rules. 

Formula 

Complement 


If A and A’ are complements then P(A) + P(A’) = 1 
Formula 
Addition Rule 


P(A OR B) = P(A) + P(B) — P(A AND B) 
Formula 
Mutually Exclusive 


If A and B are mutually exclusive then P(A AND B) = 0; so 
P(A ORB) = P(A) + P(B). 

Formula 

Multiplication Rule 


« P(A AND B) = P(B)P(A[B) 
¢ P(A AND B) = P(A)P(BJA) 


Formula 
Independence 


If A and B are independent then: 


* P(A|B) = P(A) 
* P(BJA) = P(B) 
¢ P(A AND B) = P(A)P(B) 


Probability Topics: Practice 1: Contingency Tables (modified R. Bloom) 


Student Learning Objectives 


e The student will practice constructing and interpreting contingency tables. 


Given 


An article in the New England Journal of Medicine (by Haiman, Stram, Wilkens, Pike, et al., 1/26/06), 
reported about a study of smokers in California and Hawaii. In one part of the report, the self-reported 
ethnicity and smoking levels per day were given. Of the people smoking at most 10 cigarettes per day, 
there were 9886 African Americans, 2745 Native Hawaiians, 12,831 Latinos, 8378 Japanese 
Americans, and 7650 Whites. Of the people smoking 11-20 cigarettes per day, there were 6514 
African Americans, 3062 Native Hawaiians, 4932 Latinos, 10,680 Japanese Americans, and 9877 
Whites. Of the people smoking 21-30 cigarettes per day, there were 1671 African Americans, 1419 
Native Hawaiians, 1406 Latinos, 4715 Japanese Americans, and 6062 Whites. Of the people smoking 
at least 31 cigarettes per day, there were 759 African Americans, 788 Native Hawaiians, 800 Latinos, 
2305 Japanese Americans, and 3970 Whites. 


Complete the Table 


Verify that the data above is entered into the table correctly. 


Smoking African Native Japanese 

Level American Hawaiian Latino Americans White TOTALS 
1-10 9886 2745 12831 8378 7650 41490 
11-20 6514 3062 4932 10680 9877 35065 
21-30 1671 1419 1406 4715 6062 15273 
al+ 759 788 800 2305 3970 8622 
TOTALS 18830 8014 19969 26078 27509 100450 


Smoking Levels by Ethnicity 


Analyze the Data 


Suppose that one person from the study is randomly selected. 
Exercise: 


Problem: Find the probability that person smoked 11-20 cigarettes per day. 


Solution: 


35,065 
100,450 


Exercise: 


Problem: Find the probability that person was Latino. 


Solution: 


19,969 
100,450 


Discussion Questions 


Exercise: 


Problem: 


In words, explain what it means to pick one person from the study and that person is “Japanese 
American AND smokes 21-30 cigarettes per day.” Also, find the probability. 


Solution: 


4,715 
100,450 


Exercise: 


Problem: 


In words, explain what it means to pick one person from the study and that person is “Japanese 
American OR smokes 21-30 cigarettes per day.” Also, find the probability. 


Solution: 


36,636 
100,450 


Exercise: 


Problem: 


In words, explain what it means to pick one person from the study and that person is “Japanese 
American GIVEN that person smokes 21-30 cigarettes per day.” Also, find the probability. 


Solution: 


4715 
15,273 


Exercise: 


Problem: Prove that smoking level/day and ethnicity are dependent events. 


Practice 2: Calculating Probabilities 

This module allows students to practice using what they've learned about Probability. Students will apply their 
understanding of basic probability terms, calculate probabilities based on the data provided, and determine whether 
events are independent or mutually exclusive. 


Student Learning Outcomes 
e Students will define basic probability terms. 


e Students will calculate probabilities. 
e Students will determine whether two events are mutually exclusive or whether two events are independent. 


Note: Use probability rules to solve the problems below. Show your work. 


Given 

48% of all Californians registered voters prefer life in prison without parole over the death penalty for a person 
convicted of first degree murder. Among Latino California registered voters, 55% prefer life in prison without 
parole over the death penalty for a person convicted of first degree murder. (Source: 
http://field.com/fieldpollonline/subscribers/RIs2393.pdf ). 

37.6% of all Californians are Latino (Source: U.S. Census Bureau). 

In this problem, let: 


C = Californians (registered voters) preferring life in prison without parole over the death penalty f 
e L = Latino Californians 


Suppose that one Californian is randomly selected. 


Analyze the Data 
Exercise: 
Problem: P(C) = 
Solution: 


0.48 


Exercise: 


Problem: P(L) = 


Solution: 


0.376 


Exercise: 
Problem: P(C|L) = 


Solution: 


0.55 


Exercise: 


Problem: In words, what is " C'|L"? 


Exercise: 


Problem: P(L AND C) = 


Solution: 


0.2068 


Exercise: 


Problem: [In words, what is “Z and C”’? 


Exercise: 


Problem: Are L and C’ independent events? Show why or why not. 


Solution: 
No 


Exercise: 


Problem: P(L OR C) = 


Solution: 
0.6492 


Exercise: 


Problem: [In words, what is “Z or C”? 


Exercise: 


Problem: Are LZ and C’' mutually exclusive events? Show why or why not. 


Solution: 


No 


Probability Topics Homework Link (Collaborative Statistics; R. Bloom 
custom version) 


Link to homework questions in Homework Collection/Book for Probability 
Topics Chapter 3 of Collaborative Statistics for R. Bloom 


Chapter 3 Review Questions Link (Collaborative Statistics; R. Bloom 
custom version) 


Link to Review Questions in Homework Collection/Book for Probability 
Topics Chapter 3 of Collaborative Statistics for R. Bloom 


Chapter 3 Review Questions (_http://cnx.org/content/m19023/latest/_) 


Discrete Random Variables 
This module serves as the introduction to Discrete Random Variables in the 
Elementary Statistics textbook/collection. 


Student Learning Outcomes 
By the end of this chapter, the student should be able to: 


¢ Recognize and understand discrete probability distribution functions, 
in general. 

e Calculate and interpret expected values. 

e Recognize the binomial probability distribution and apply it 
appropriately. 

e Recognize the Poisson probability distribution and apply it 
appropriately (optional). 

e Recognize the geometric probability distribution and apply it 
appropriately (optional). 

e Recognize the hypergeometric probability distribution and apply it 
appropriately (optional). 

e Classify discrete word problems by their distributions. 


Introduction 


A student takes a 10 question true-false quiz. Because the student had such 
a busy schedule, he or she could not study and randomly guesses at each 
answer. What is the probability of the student passing the test with at least a 
70%? 


Small companies might be interested in the number of long distance phone 
calls their employees make during the peak time of the day. Suppose the 
average is 20 calls. What is the probability that the employees make more 
than 20 long distance phone calls during the peak time? 


These two examples illustrate two different types of probability problems 
involving discrete random variables. Recall that discrete data are data that 
you can count. A random variable describes the outcomes of a statistical 


experiment in words. The values of a random variable can vary with each 
repetition of an experiment. 


In this chapter, you will study probability problems involving discrete 
random distributions. You will also study long-term averages associated 
with them. 


Random Variable Notation 


Upper case letters like X or Y denote a random variable. Lower case letters 
like x or y denote the value of a random variable. If X is a random 
variable, then X is written in words. and z is given as a number. 


For example, let X = the number of heads you get when you toss three fair 
coins. The sample space for the toss of three fair coins is TTT THH HTH 
HHT HTT THT TTH HHH. Then, zx = 0, 1, 2, 3. X is in words and z is 
a number. Notice that for this example, the x values are countable 
outcomes. Because you can count the possible values that X can take on 
and the outcomes are random (the z values 0, 1, 2, 3), X is a discrete 
random variable. 


Optional Collaborative Classroom Activity 


Toss a coin 10 times and record the number of heads. After all members of 
the class have completed the experiment (tossed a coin 10 times and 
counted the number of heads), fill in the chart using a heading like the one 
below. Let X = the number of heads in 10 tosses of the coin. 


x Frequency of x Relative Frequency of x 


x Frequency of x Relative Frequency of x 


e Which value(s) of x occurred most frequently? 

e If you tossed the coin 1,000 times, what values could x take on? 
Which value(s) of z do you think would occur most frequently? 

e What does the relative frequency column sum to? 


Glossary 


Random Variable (RV) 
see Variable 


Variable (Random Variable) 
A characteristic of interest in a population being studied. Common 
notation for variables are upper case Latin letters X, Y, Z,...; common 
notation for a specific value from the domain (set of all possible values 
of a variable) are lower case Latin letters x, y, z,.... For example, if X 
is the number of children in a family, then x represents a specific 
integer 0, 1, 2, 3, .... Variables in statistics differ from variables in 
intermediate algebra in two following ways. 


e The domain of the random variable (RV) is not necessarily a 
numerical set; the domain may be expressed in words; for 
example, if X = hair color then the domain is {black, blond, gray, 
green, orange}. 

e We can tell what specific value xz of the Random Variable X takes 
only after performing the experiment. 


Probability Distribution Function (PDF) for a Discrete Random Variable 
This module introduces the Probability Distribution Function (PDF) and its 
characteristics. 


A discrete probability distribution function has two characteristics: 


e Each probability is between 0 and 1, inclusive. 
e The sum of the probabilities is 1. 


Example: 

A child psychologist is interested in the number of times a newborn baby's 
crying wakes its mother after midnight. For a random sample of 50 
mothers, the following information was obtained. Let _X = the number of 
times a newborn wakes its mother after midnight. For this example, x = 0, 
| Pare ac. ey 

P(x) = probability that X takes on a value z. 


x P(x) 

0 ree) = = 
1 P(ix=1) = _ 
2 x2) = 
3 Puss) = = 
4 Pix=4)— = 


P(x=5) = 4 


X takes on the values 0, 1, 2, 3, 4, 5. This is a discrete PDF because 


1. Each P(x) is between 0 and 1, inclusive. 
2. The sum of the probabilities is 1, that is, 


Equation: 


Zp lies eat a es 
50 50 50 50 50 50, 


Example: 


Suppose Nancy has classes 3 days a week. She attends classes 3 days a 
week 80% of the time, 2 days 15% of the time, 1 day 4% of the time, and 


no days 1% of the time. Suppose one week is randomly selected. 
Exercise: 


Problem: 

Let X = the number of days Nancy 

Solution: 

Let X = the number of days Nancy attends class per week. 
Exercise: 

Problem: X takes on what values? 

Solution: 


Oo. 2.-and:s 


Exercise: 


Problem: 


Suppose one week is randomly chosen. Construct a probability 
distribution table (called a PDF table) like the one in the previous 
example. The table should have two columns labeled x and P(x). 
What does the P(x) column sum to? 


Solution: 
x P(x) 
0 0.01 
1 0.04 
2 0.15 
3 0.80 
Glossary 


Probability Distribution Function (PDF) 
A mathematical description of a discrete random variable (RV), given 
either in the form of an equation (formula) , or in the form of a table 
listing all the possible outcomes of an experiment and the probability 
associated with each outcome. 


Example: 

A biased coin with probability 0.7 for a head (in one toss of the coin) is 
tossed 5 times. We are interested in the number of heads (the RV X = the 
number of heads). X is Binomial, so X ~ B(5,0.7) and P(X = x) = 


5 
( ) _77.3°-*or in the form of the table: 
x 


L P(x = 2) 
0 0.0024 
1 0.0284 
2 0.1323 
3 0.3087 
4 0.3602 


Mean or Expected Value and Standard Deviation 

This module explores the Law of Large Numbers, the phenomenon where 
an experiment performed many times will yield cumulative results closer 
and closer to the theoretical mean over time. 


The expected value is often referred to as the "long-term" average or 
mean . This means that over the long term of doing an experiment over and 
over, you would expect this average. 


The mean of a random variable X is ps. If we do an experiment many times 
(for instance, flip a fair coin, as Karl Pearson did, 24,000 times and let X = 
the number of heads) and record the value of X each time, the average is 
likely to get closer and closer to yz as we keep repeating the experiment. 
This is known as the Law of Large Numbers. 


Note:To find the expected value or long term average, jz, simply multiply 
each value of the random variable by its probability and add the products. 


A Step-by-Step Example 

A men's soccer team plays soccer 0, 1, or 2 days a week. The probability 
that they play O days is 0.2, the probability that they play 1 day is 0.5, and 
the probability that they play 2 days is 0.3. Find the long-term average, jp, 
or expected value of the days per week the men's soccer team plays soccer. 


To do the problem, first let the random variable X = the number of days the 
men's soccer team plays soccer per week. X takes on the values 0, 1, 2. 
Construct a PDF table, adding a column xP(x). In this column, you will 
multiply each z value by its probability. 


x P(x) tP(x) 


0 0.2 (0)(0.2) = 0 
1 0.5 (1)(0.5) = 0.5 
2 0.3 (2)(0.3) = 0.6 


Expected Value TableThis table is called an expected value table. The table 
helps you calculate the expected value or long-term average. 


Add the last column to find the long term average or expected value: 
(0)(0.2)+(1)(0.5)+(2)(0.3)= 0 + 0.5 + 0.6 = 1.1. 


The expected value is 1.1. The men's soccer team would, on the average, 
expect to play soccer 1.1 days per week. The number 1.1 is the long term 
average or expected value if the men's soccer team plays soccer week after 
week after week. We say H=1.1 


Example: 

Find the expected value for the example about the number of times a 
newborn baby's crying wakes its mother after midnight. The expected 
value is the expected number of times a newborn wakes its mother after 
midnight. 


2 P(X) xP(X 


—_—— 


0 P(x=0) = (0)(s5) =0 


1 P(x=1) = 5 (D(a) = 3 
2 P(x=2) = #3 (2)(3>) = 3 
3 PE) = a (3)(s5) = 3 
4 Ria (4)(4)=-4 
5 Poo, 6)(a)=4 


You expect a newborn to wake its mother after midnight 2.1 times, on the 
average. 


Add the last column to find the expected value. jz = Expected Value = 
105 __ 

9 = 2-1 

Exercise: 


Problem: 


Go back and calculate the expected value for the number of days 
Nancy attends classes a week. Construct the third column to do so. 


Solution: 


2.74 days a week. 


Example: 

Suppose you play a game of chance in which five numbers are chosen 
from 0, 1, 2, 3, 4, 5, 6, 7, 8, 9. A computer randomly selects five numbers 
from 0 to 9 with replacement. You pay $2 to play and could profit 
$100,000 if you match all 5 numbers in order (you get your $2 back plus 


$100,000). Over the long term, what is your expected profit of playing the 
game? 

To do this problem, set up an expected value table for the amount of money 
you can profit. 

Let X = the amount of money you profit. The values of x are not 0, 1, 2, 3, 
4, 5, 6, 7, 8, 9. Since you are interested in your profit (or loss), the values 
of x are 100,000 dollars and -2 dollars. 

To win, you must get all 5 numbers correct, in order. The probability of 
choosing one correct number is ay because there are 10 numbers. You may 
choose a number more than once. The probability of choosing all 5 
numbers correctly and in order is: 

Equation: 


—_*__* __* ___*__*_ 1*19~° = 0.00001 
10 10 10 10 10 ees 


Therefore, the probability of winning is 0.00001 and the probability of 
losing is 
Equation: 


1 — 0.00001 = 0.99999 


The expected value table is as follows. 


x P(x) xzP(x) 
Loss 2 0.99999 (-2)(0.99999)=-1.99998 
Profit 100,000 0.00001 (100000)(0.00001)=1 


Add the last column. -1.99998 + 1 = -0.99998 


Since —0.99998 is about —1, you would, on the average, expect to lose 
approximately one dollar for each game you play. However, each time you 
play, you either lose $2 or profit $100,000. The $1 is the average or 
expected LOSS per game after playing this game over and over. 


Example: 
Suppose you play a game with a biased coin. You play each game by 
tossing the coin once. P(heads) = 3 and P(tails) = 4. If you toss a 


head, you pay $6. If you toss a tail, you win $10. If you play this game 
many times, will you come out ahead? 
Exercise: 


Problem: Define a random variable X. 


Solution: 


X = amount of profit 


Exercise: 


Problem: Complete the following expected value table. 


eo] 


WIN 10 


LOSE 


Solution: 


x P(x) xzP(x) 
WIN 10 + 2 
LOSE -6 2 


Exercise: 


Problem: What is the expected value, ? Do you come out ahead? 


Solution: 


Add the last column of the table. The expected value pz = =. You 


lose, on average, about 67 cents each time you play the game so you 
do not come out ahead. 


Like data, probability distributions have standard deviations. To calculate 
the standard deviation (@) of a probability distribution, find each deviation 
from its expected value, square it, multiply it by its probability, add the 
products, and take the square root . To understand how to do the calculation, 
look at the table for the number of days per week a men's soccer team plays 
soccer. To find the standard deviation, add the entries in the column labeled 


(x — p)?- P(z) and take the square root. 


z P(x) aP(x) (x -p)°P (x) 


0 | o2 (0)(0.2) = 0 (0 — 1.1) (.2) ~ 0.242 
1 05 (1)(0.5) = 0.5 Geta)? (.5) = 0.005 
2 | 03 (2)(0.3) = 0.6 44) (.3) ~ 0.243 


Add the last column in the table. 0.242 + 0.005 + 0.243 = 0.490. The 
standard deviation is the square root of 0.49. 0 = / 0.49 — 0.7 


Generally for probability distributions, we use a calculator or a computer to 
calculate 4 and o to reduce roundoff error. For some probability 
distributions, there are short-cut formulas that calculate jz and o. 


Glossary 


Expected Value 
Expected arithmetic average when an experiment is repeated many 
times. (Also called the mean). Notations: F(a), jw. For a discrete 
random variable (RV) with probability distribution function P(a),the 
definition can also be written in the form E(x) = uw = 5) xP(z). 


Mean 
A number that measures the central tendency. A common name for 
mean is ‘average.’ The term 'mean' is a shortened form of ‘arithmetic 
mean.’ By definition, the mean for a sample (denoted by 2) is 
— _ Sum of all values in the sample dth i lati 
Lar Number of values in the sample ’ at € mean for a population 
Sum of all values in the population 
Number of values in the population ° 


(denoted by sz) is w = 


Common Discrete Probability Distribution Functions 

This module serves as a lead-in for several types of common discrete 
probability distribution functions, including binomial, geometric, 
hypergeometric, and Poisson. 


Some of the more common discrete probability functions are binomial, 
geometric, hypergeometric, and Poisson. Most elementary courses do not 
cover the geometric, hypergeometric, and Poisson. Your instructor will let 
you know if he or she wishes to cover these distributions. 


A probability distribution function is a pattern. You try to fit a probability 
problem into a pattern or distribution in order to perform the necessary 
calculations. These distributions are tools to make solving probability 
problems easier. Each distribution has its own special characteristics. 
Learning the characteristics enables you to distinguish among the different 
distributions. 


Binomial Distribution 
This module describes the characteristics of a binomial experiment and the 
binomial probability distribution function. 


The characteristics of a binomial experiment are: 


1. 


Z. 


There are a fixed number of trials. Think of trials as repetitions of an 
experiment. The letter m denotes the number of trials. 

There are only 2 possible outcomes, called "success" and, "failure" for 
each trial. The letter p denotes the probability of a success on one trial 
and q denotes the probability of a failure on one trial. p + q = 1. 


. The 7 trials are independent and are repeated using identical 


conditions. Because the n trials are independent, the outcome of one 
trial does not help in predicting the outcome of another trial. Another 
way of saying this is that for each individual trial, the probability, p, of 
a success and probability, g, of a failure remain the same. For example, 
randomly guessing at a true - false statistics question has only two 
outcomes. If a success is guessing correctly, then a failure is guessing 
incorrectly. Suppose Joe always guesses correctly on any statistics true 
- false question with probability p = 0.6. Then, q = 0.4 .This means 
that for every true - false statistics question Joe answers, his 
probability of success (p = 0.6) and his probability of failure (q = 0.4 
) remain the same. 


The outcomes of a binomial experiment fit a binomial probability 
distribution. The random variable X = the number of successes obtained 
in the n independent trials. 


The mean, jz, and variance, o”, for the binomial probability distribution is 
y. = np and o? = npq. The standard deviation, a, is then o = ,/npq. 


Any experiment that has characteristics 2 and 3 and where n = 1 is calleda 
Bernoulli Trial (named after Jacob Bernoulli who, in the late 1600s, 
studied them extensively). A binomial experiment takes place when the 
number of successes is counted in one or more Bernoulli Trials. 


Example: 

At ABC College, the withdrawal rate from an elementary physics course is 
30% for any given term. This implies that, for any given term, 70% of the 
students stay in the class for the entire term. A "success" could be defined 
as an individual who withdrew. The random variable is X = the number of 
students who withdraw from the randomly selected elementary physics 
class. 


Example: 

Suppose you play a game that you can only either win or lose. The 
probability that you win any game is 55% and the probability that you lose 
is 45%. Each game you play is independent. If you play the game 20 times, 
what is the probability that you win 15 of the 20 games? Here, if you 
define X = the number of wins, then X takes on the values 0, 1, 2, 3, ..., 
20. The probability of a success is p = 0.55. The probability of a failure is 
q = 0.45. The number of trials ism = 20. The probability question can be 
stated mathematically as P(a = 15). 


Example: 

A fair coin is flipped 15 times. Each flip is independent. What is the 
probability of getting more than 10 heads? Let X = the number of heads in 
15 flips of the fair coin. X takes on the values 0, 1, 2, 3, ..., 15. Since the 
coin is fair, p = 0.5 and q = 0.5. The number of trials is n = 15. The 
probability question can be stated mathematically as P(a > 10). 


Example: 

Approximately 70% of statistics students do their homework in time for it 
to be collected and graded. Each student does homework independently. In 
a Statistics class of 50 students, what is the probability that at least 40 will 
do their homework on time? Students are selected randomly. 

Exercise: 


Problem: 


This is a binomial problem because there is only a success or a 
, there are a definite number of trials, and the probability 
of a success is 0.70 for each trial. 


Solution: 


failure 
Exercise: 


Problem: 


If we are interested in the number of students who do their homework, 
then how do we define X? 


Solution: 

X =the number of statistics students who do their homework on time 
Exercise: 

Problem: What values does zx take on? 


Solution: 
Ole 0) 
Exercise: 


Problem: What is a "failure", in words? 


Solution: 


Failure is a student who does not do his or her homework on time. 


The probability of a success is p = 0.70. The number of trial is n = 50. 
Exercise: 


Problem: If p + gq = 1, then what is q? 
Solution: 


gq = 0.30 
Exercise: 
Problem: 


The words "at least" translate as what kind of inequality for the 
probability question P(a____40). 


Solution: 


greater than or equal to (=) 


The probability question is P(a > 40). 


Notation for the Binomial: B = Binomial Probability 
Distribution Function 


X ~ B(n,p) 


Read this as ".X is arandom variable with a binomial distribution." The 
parameters are n and p. n = number of trials p = probability of a success on 
each trial 


Example: 

It has been stated that about 41% of adult workers have a high school 
diploma but do not pursue any further education. If 20 adult workers are 
randomly selected, find the probability that at most 12 of them have a high 
school diploma but do not pursue any further education. How many adult 


workers do you expect to have a high school diploma but do not pursue 
any further education? 

Let X = the number of workers who have a high school diploma but do not 
pursue any further education. 

X takes on the values 0, 1, 2, ..., 20 where n = 20 and p = 0.41. q=1- 
0.41 = 0.59. X ~ B(20, 0.41) 

Find P(x < 12). P(a < 12) = 0.9738. (calculator or computer) 

Using the TI-83+ or the TI-84 calculators, the calculations are as follows. 
Go into 2nd DISTR. The syntax for the instructions are 

To calculate (x = value): binompdf(n, p, number) If "number" is left out, 
the result is the binomial probability table. 

To calculate P(x < value): binomcdf(n, p, number) If "number" is left 
out, the result is the cumulative binomial probability table. 

For this problem: After you are in 2nd DISTR, arrow down to 
binomcdf. Press ENTER. Enter 20,.41,12). The result is 

(12 O88: 


Note:If you want to find P(a = 12), use the pdf (binompdf). If you want 
to find P(x>12), use 1 - binomcdf(20,.41,12). 


The probability at most 12 workers have a high school diploma but do not 
pursue any further education is 0.9738 
The graph of x ~ B(20, 0.41) is: 


0123 4 Sires» 20 


The y-axis contains the probability of 2, where X = the number of workers 
who have only a high school diploma. 

The number of adult workers that you expect to have a high school 
diploma but not pursue any further education is the mean, 

fe — np —"(20)( OAT) 62; 

The formula for the variance is o“ = npq. The standard deviation is 

o = ./upq. o = »/(20)(0.41)(0.59) = 2.20. 
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Example: 

The following example illustrates a problem that is not binomial. It 
violates the condition of independence. ABC College has a student 
advisory committee made up of 10 staff members and 6 students. The 
committee wishes to choose a chairperson and a recorder. What is the 
probability that the chairperson and recorder are both students? All names 
of the committee are put into a box and two names are drawn without 
replacement. The first name drawn determines the chairperson and the 
second name the recorder. There are two trials. However, the trials are not 
independent because the outcome of the first trial affects the outcome of 
the second trial. The probability of a student on the first draw is +. The 


probability of a student on the second draw is — when the first draw 
produces a student. The probability is a when the first draw produces a 


staff member. The probability of drawing a student's name changes for 
each of the trials and, therefore, violates the condition of independence. 


Glossary 


Bernoulli Trials 
An experiment with the following characteristics: 


e There are only 2 possible outcomes called “success” and “failure” 
for each trial. 

e The probability p of a success is the same for any trial (so the 
probability g = 1 — p of a failure is the same for any trial). 


Binomial Distribution 
A discrete random variable (RV) which arises from Bernoulli trials. 
There are a fixed number, n, of independent trials. “Independent” 
means that the result of any trial (for example, trial 1) does not affect 
the results of the following trials, and all trials are conducted under the 
same conditions. Under these circumstances the binomial RV X is 
defined as the number of successes in n trials. The notation is: X~ 
B(n, p). The mean is js = np and the standard deviation is o = ,/npq 
. The probability of exactly z successes in 7 trials is 


P(X = 2) = (2 )p*q"*. 


Geometric Distribution 

This module describes the geometric experiment and the geometric 
probability distribution. This module is included in the Collaborative 
Statistics textbook/collection as an optional lesson. 


The characteristics of a geometric experiment are: 


1. There are one or more Bernoulli trials with all failures except the last 
one, which is a success. In other words, you keep repeating what you 
are doing until the first success. Then you stop. For example, you 
throw a dart at a bull's eye until you hit the bull's eye. The first time 
you hit the bull's eye is a "success" so you stop throwing the dart. It 
might take you 6 tries until you hit the bull's eye. You can think of the 
trials as failure, failure, failure, failure, failure, success. STOP. 

. In theory, the number of trials could go on forever. There must be at 
least one trial. 

. The probability,p, of a success and the probability, qg, of a failure is the 
same for each trial. p + gq = 1 and q = 1 — p. For example, the 
probability of rolling a 3 when you throw one fair die is <- This is true 
no matter how many times you roll the die. Suppose you want to know 
the probability of getting the first 3 on the fifth roll. On rolls 1, 2, 3, 
and 4, you do not get a face with a 3. The probability for each of rolls 
1, 2, 3, and 4 is gq = 2, the probability of a failure. The probability of 


getting a 3 on the fifth roll is 2 . 2 . 2. : 2 : + = 0.0804 


X = the number of independent trials until the first success. The mean and 


variance are in the summary in this chapter. 


Example: 
You play a game of chance that you can either win or lose (there are no 


other possibilities) until you lose. Your probability of losing is p = 0.57. 


What is the probability that it takes 5 games until you lose? Let X = the 


number of games you play until you lose (includes the losing game). Then 
X takes on the values 1, 2, 3, ... (could go on indefinitely). The probability 


question is P(x = 5). 


Example: 

A safety engineer feels that 35% of all industrial accidents in her plant are 
caused by failure of employees to follow instructions. She decides to look 
at the accident reports (selected randomly and replaced in the pile after 
reading) until she finds one that shows an accident caused by failure of 
employees to follow instructions. On the average, how many reports would 
the safety engineer expect to look at until she finds a report showing an 
accident caused by employee failure to follow instructions? What is the 
probability that the safety engineer will have to examine at least 3 reports 
until she finds a report showing an accident caused by employee failure to 
follow instructions? 

Let X = the number of accidents the safety engineer must examine until 
she finds a report showing an accident caused by employee failure to 
follow instructions. X takes on the values 1, 2, 3, .... The first question 
asks you to find the expected value or the mean. The second question asks 
you to find P(x > 3). ("At least" translates as a "greater than or equal to" 
symbol). 


Example: 

Suppose that you are looking for a student at your college who lives within 
five miles of you. You know that 55% of the 25,000 students do live within 
five miles of you. You randomly contact students from the college until 
one says he/she lives within five miles of you. What is the probability that 
you need to contact four people? 

This is a geometric problem because you may have a number of failures 
before you have the one success you desire. Also, the probability of a 
success stays the same each time you ask a student if he/she lives within 
five miles of you. There is no definite number of trials (number of times 
you ask a student). 

Exercise: 


Problem: 


Let X = the number of you must ask 
one says yes. 


Solution: 


Let X = the number of students you must ask until one says yes. 


Exercise: 


Problem: What values does X take on? 


Solution: 


1, 2, 3, ..., (total number of students) 


Exercise: 


Problem: What are p and q? 


Solution: 
e p=0.55 
e g=0.45 
Exercise: 
Problem: The probability question is P( ). 
Solution: 
Pi) 


Notation for the Geometric: G = Geometric Probability 
Distribution Function 


X*~ Gp) 


Read this as "X is arandom variable with a geometric distribution." The 
parameter is p. p = the probability of a success for each trial. 


Example: 

Assume that the probability of a defective computer component is 0.02. 
Components are randomly selected. Find the probability that the first 
defect is caused by the 7th component tested. How many components do 
you expect to test until one is found to be defective? 

Let X = the number of computer components tested until the first defect is 
found. 

X takes on the values 1, 2, 3, ... where p = 0.02. X ~ G(0.02) 

Find P(x = 7). P(a = 7) = 0.0177. (calculator or computer) 

TI-83+ and TI-84: For a general discussion, see this example (binomial). 
The syntax is similar. The geometric parameter list is (p, number) If 
"number" is left out, the result is the geometric probability table. For this 
problem: After you are in 2nd DISTR, arrow down to D:geometpdf. 
Press ENTER. Enter .02,7). The result is P(x = 7) = 0.0177. 

The probability that the 7th component is the first defect is 0.0177. 

The graph of X ~ G(0.02) is: 


P(X=x) 


0.01 
0.005 
0 


The y-axis contains the probability of x, where X = the number of 
computer components tested. 
The number of components that you would expect to test until you find the 
first defective one is the mean, jz = 50. 
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The formula for the mean is wy = - = 00 = 50 


The formula for the variance is 


oP = 1. (1-1) = gy: (gy - 1) = 2480 


The standard deviation is 


/ 1 1 1 1 


Glossary 


Geometric Distribution 
A discrete random variable (RV) which arises from the Bernoulli trials. 
The trials are repeated until the first success. The geometric variable X 
is defined as the number of trials until the first success. Notation: X ~ 
G(p). The mean is pw = . and the standard deviation is 


C= > : (+ = 1) The probability of exactly x failures before the 


first success is given by the formula: P(X = x) = p(1— p)?"1. 


Hypergeometric Distribution (Optional) 

This module describes the properties of a hypergeometric experiment and 
hypergeometric probability distribution. This module is included in the 
Collaborative Statistics textbook/collection as an optional lesson. 


The characteristics of a hypergeometric experiment are: 


1. You take samples from 2 groups. 

2. You are concerned with a group of interest, called the first group. 

3. You sample without replacement from the combined groups. For 
example, you want to choose a softball team from a combined group of 
11 men and 13 women. The team consists of 10 players. 

4. Each pick is not independent, since sampling is without replacement. 
In the softball example, the probability of picking a women first is oe 

The probability of picking a man second is sy if a woman was picked 

first. It is iy if a man was picked first. The probability of the second 


pick depends on what happened in the first pick. 
5. You are not dealing with Bernoulli Trials. 


The outcomes of a hypergeometric experiment fit a hypergeometric 
probability distribution. The random variable X = the number of items 
from the group of interest. The mean and variance are given in the 
summary. 


Example: 

A candy dish contains 100 jelly beans and 80 gumdrops. Fifty candies are 
picked at random. What is the probability that 35 of the 50 are gumdrops? 
The two groups are jelly beans and gumdrops. Since the probability 
question asks for the probability of picking gumdrops, the group of interest 
(first group) is gumdrops. The size of the group of interest (first group) is 
80. The size of the second group is 100. The size of the sample is 50 (jelly 
beans or gumdrops). Let X = the number of gumdrops in the sample of 50. 
X takes on the values x = 0, 1, 2, ..., 50. The probability question is 

VG 85), 


Example: 

Suppose a shipment of 100 VCRs is known to have 10 defective VCRs. An 
inspector randomly chooses 12 for inspection. He is interested in 
determining the probability that, among the 12, at most 2 are defective. 
The two groups are the 90 non-defective VCRs and the 10 defective VCRs. 
The group of interest (first group) is the defective group because the 
probability question asks for the probability of at most 2 defective VCRs. 
The size of the sample is 12 VCRs. (They may be non-defective or 
defective.) Let X = the number of defective VCRs in the sample of 12. X 
takes on the values 0, 1, 2, ..., 10. X may not take on the values 11 or 12. 
The sample size is 12, but there are only 10 defective VCRs. The inspector 
wants to know P(# < 2) ("At most" means "less than or equal to"). 


Example: 

You are president of an on-campus special events organization. You need a 
committee of 7 to plan a special birthday party for the president of the 
college. Your organization consists of 18 women and 15 men. You are 
interested in the number of men on your committee. If the members of the 
committee are randomly selected, what is the probability that your 
committee has more than 4 men? 

This is a hypergeometric problem because you are choosing your 
committee from two groups (men and women). 

Exercise: 


Problem: Are you choosing with or without replacement? 


Solution: 


Without 


Exercise: 


Problem: What is the group of interest? 


Solution: 


The men 

Exercise: 
Problem: How many are in the group of interest? 
Solution: 
15 men 

Exercise: 
Problem: How many are in the other group? 
Solution: 


18 women 
Exercise: 


Problem: 

Let X = on the committee. What values does X take on? 

Solution: 

Let X = the number of men on the committee. x = 0, 1, 2, ..., 7. 
Exercise: 

Problem:The probability question is P(___). 


Solution: 


P(x>4) 


Notation for the Hypergeometric: H = Hypergeometric 
Probability Distribution Function 


X~H(r, b, n) 


Read this as ".X is arandom variable with a hypergeometric distribution." 
The parameters are r, b, and n. r = the size of the group of interest (first 
group), b = the size of the second group, n = the size of the chosen sample 


Example: 

A school site committee is to be chosen randomly from 6 men and 5 
women. If the committee consists of 4 members chosen randomly, what is 
the probability that 2 of them are men? How many men do you expect to 
be on the committee? 

Let X = the number of men on the committee of 4. The men are the group 
of interest (first group). 

X takes on the values 0, 1, 2, 3, 4, where r = 6,6 = 5,andn= 4. 
X~H(6, 5, 4) 

Find P(x = 2). P(x = 2) = 0.4545 (calculator or computer) 


Note:Currently, the TI-83+ and TI-84 do not have hypergeometric 
probability functions. There are a number of computer packages, 
including Microsoft Excel, that do. 


The probability that there are 2 men on the committee is about 0.45. 
The graph of X~H(6, 5, 4) is: 


P(X=x) 


The y-axis contains the probability of X, where X = the number of men on 


the committee. 
You would expect m = 2.18 (about 2) men on the committee. 


The formula for the mean is uw = 77> = oe =218 
The formula for the variance is fairly complex. You will find it in the 
Summary of the Discrete Probability Functions Chapter, 


Glossary 


Hypergeometric Distribution 
A discrete random variable (RV) that is characterized by 


e A fixed number of trials. 
e The probability of success is not the same from trial to trial. 


We sample from two groups of items when we are interested in only 
one group. X is defined as the number of successes out of the total 
number of items chosen. Notation: X~H(r,b,n)., where r = the 


number of items in the group of interest, b = the number of items in the 
group not of interest, and nm = the number of items chosen. 


Poisson Distribution (Optional) 

This module describes the characteristics of a Poisson experiment and the 
Poisson probability distribution. This module is included in the Elementary 
Statistics textbook/collection as an optional lesson. 


Characteristics of a Poisson experiment: 


1. The Poisson gives the probability of a number of events occurring in a 
fixed interval of time or space if these events happen with a known 
average rate and independently of the time since the last event. For 
example, a book editor might be interested in the number of words 
spelled incorrectly in a particular book. It might be that, on the 
average, there are 5 words spelled incorrectly in 100 pages. The 
interval is the 100 pages. 

2. The Poisson may be used to approximate the binomial if the 
probability of success is "small" (such as 0.01) and the number of trials 
is "large" (such as 1000). You will verify the relationship in the 
homework exercises. n is the number of trials and p is the probability 
of a "success." 


Poisson probability distribution. The random variable X = the number of 
occurrences in the interval of interest. The mean and variance are given in 
the summary. 


Example: 

The average number of loaves of bread put on a shelf in a bakery in a half- 
hour period is 12. Of interest is the number of loaves of bread put on the 
shelf in 5 minutes. The time interval of interest is 5 minutes. What is the 
probability that the number of loaves, selected randomly, put on the shelf 
in 5 minutes is 3? 

Let X = the number of loaves of bread put on the shelf in 5 minutes. If the 
average number of loaves put on the shelf in 30 minutes (half-hour) is 12, 
then the average number of loaves put on the shelf in 5 minutes is 
(=) - 12 = 2 loaves of bread 


The probability question asks you to find P(x = 3). 


Example: 

A certain bank expects to receive 6 bad checks per day, on average. What 
is the probability of the bank getting fewer than 5 bad checks on any given 
day? Of interest is the number of checks the bank receives in 1 day, so the 
time interval of interest is 1 day. Let X = the number of bad checks the 
bank receives in one day. If the bank expects to receive 6 bad checks per 
day then the average is 6 checks per day. The probability question asks for 
Jed acess) 


Example: 

You notice that a news reporter says "uh", on average, 2 times per 
broadcast. What is the probability that the news reporter says "uh" more 
than 2 times per broadcast. 

This is a Poisson problem because you are interested in knowing the 
number of times the news reporter says "uh" during a broadcast. 
Exercise: 


Problem: What is the interval of interest? 
Solution: 


One broadcast 
Exercise: 


Problem: 


What is the average number of times the news reporter says "uh" 
during one broadcast? 


Solution: 


2 


Exercise: 


Problem: Let X = . What values does X take on? 
Solution: 


Let X = the number of times the news reporter says "uh" during 
one broadcast. 
faa Va lee are eae 


Exercise: 


Problem: The probability question is P(____). 


Solution: 


Pixe2) 


Notation for the Poisson: P = Poisson Probability Distribution 
Function 


X~ P(u) 


Read this as "X is arandom variable with a Poisson distribution." The 
parameter is yz (or A). ps (or A) = the mean for the interval of interest. 


Example: 

Leah's answering machine receives about 6 telephone calls between 8 a.m. 
and 10 a.m. What is the probability that Leah receives more than 1 call in 

the next 15 minutes? 

Let X = the number of calls Leah receives in 15 minutes. (The interval of 
interest is 15 minutes or J. hour.) 

(bee 0 Della Bo Peas 


If Leah receives, on the average, 6 telephone calls in 2 hours, and there are 
eight 15 minutes intervals in 2 hours, then Leah receives 

= °6=0.75 

calls in 15 minutes, on the average. So, yz = 0.75 for this problem. 

D.C eo Vea((0). (659) 

Find P(x > 1). P(x > 1) = 0.1734 (calculator or computer) 

TI-83+ and TI-84: For a general discussion, see this example (Binomial). 
The syntax is similar. The Poisson parameter list is (jz for the interval of 
interest, number). For this problem: 

Press 1- and then press 2nd DISTR. Arrow down to C:poissoncdf. 
Press ENTER. Enter .75,1). The result is P(z > 1) = 0.1734. NOTE: 
The TI calculators use \ (lambda) for the mean. 

The probability that Leah receives more than 1 telephone call in the next 
fifteen minutes is about 0.1734. 

The graph of X ~ P(0.75) is: 


P(X=x) 


The y-axis contains the probability of z where X = the number of calls in 
15 minutes. 


Glossary 


Poisson Distribution 
A discrete random variable (RV) that counts the number of times a 
certain event will occur in a specific interval. Characteristics of the 
variable: 


e The probability that the event occurs in a given interval is the 
same for all intervals. 

e The events occur with a known mean and independently of the 
time since the last event. 


The distribution is defined by the mean yz of the event in the interval. 
Notation: X~ P(:). The mean is 4 = np. The standard deviation is 
o = ,/p. The probability of having exactly x successes in r trials is 


P(X = 2x) =e “4. The Poisson distribution is often used to 
approximate the binomial distribution when n is “large” and p is 
“small” (a general rule is that n should be greater than or equal to 20 


and p should be less than or equal to .05). 


Summary of Functions 

This module provides a review of the binomial, geometric, hypergeometric, 
and Poisson probability distribution functions and their properties. 
Formula 

Binomial 


X~B(n,p) 

X =the number of successes in n independent trials 
m = the number of independent trials 

X takes on the values z = 0,1, 2, 3, ...,n 

p = the probability of a success for any trial 

q = the probability of a failure for any trial 
Parga. GaLop 


The mean is 2 = np. The standard deviation is o = ,/npq. 


Formula 
Geometric 


X~G(p) 


X = the number of independent trials until the first success (count the 
failures and the first success) 


X takes on the values x= 1, 2, 3, ... 

p = the probability of a success for any trial 
q = the probability of a failure for any trial 
p+q=1 


q=1=p 


The mean is = : 


The standard deviation is o = > ( (+) — 1) 


Formula 
Hypergeometric 


X~H(r,b,n) 


X = the number of items from the group of interest that are in the chosen 
sample. 


X may take on the values x= 0, 1, ..., up to the size of the group of interest. 
(The minimum value for X may be larger than 0 in some instances.) 


r = the size of the group of interest (first group) 
b= the size of the second group 
n= the size of the chosen sample. 


n<r+b 


nr 


r+b 


The mean is: 2 = 


The standard deviation is: ¢ = eer a 
(r+b)°(r+b-1) 

Formula 

Poisson 

X ~ P(u) 


X =the number of occurrences in the interval of interest 
X takes on the values zx = 0, 1, 2, 3, ... 


The mean p is typically given. (A is often used as the mean instead of ju.) 
When the Poisson is used to approximate the binomial, we use the binomial 


mean ps = np. n is the binomial number of trials. p = the probability of a 
success for each trial. This formula is valid when n is "large" and p "small" 
(a general rule is that n should be greater than or equal to 20 and p should 
be less than or equal to 0.05). If n is large enough and p is small enough 
then the Poisson approximates the binomial very well. The variance is 

o? = pand the standard deviation is o = a/b 


Practice 1: Discrete Distribution 

This module provides students an opportunity to practice applying concepts 
related to discrete distributions. This practice exercise asks students to 
calculate several values based on the data provided. 


Student Learning Outcomes 


e The student will analyze the properties of a discrete distribution. 


Given: 


A ballet instructor is interested in knowing what percent of each year's class 
will continue on to the next, so that she can plan what classes to offer. Over 
the years, she has established the following probability distribution. 


e Let X =the number of years a student will study ballet with the 


teacher. 
e Let P(x) = the probability that a student will study ballet x years. 


Organize the Data 


Complete the table below using the data provided. 


x P(x) x*P(x) 
1 0.10 
2 0.05 


3 0.10 


x P(x) x*P(x) 


4 

5 0.30 

6 0.20 

Zz 0.10 
Exercise: 


Problem: In words, define the Random Variable X. 


Exercise: 


Problem: P(x = 4) = 


Exercise: 


Problem: P(x < 4) = 
Exercise: 


Problem: 
On average, how many years would you expect a child to study ballet 
with this teacher? 

Discussion Question 

Exercise: 


Problem: What does the column "P(x)" sum to and why? 


Exercise: 


Problem: What does the column "«*P(x)" sum to and why? 


Practice 2: Binomial Distribution 

This module provides a practice of Binomial Distribution as a part of 
Collaborative Statistics collection (col10522) by Barbara Illowsky and 
Susan Dean. 


Student Learning Outcomes 


e The student will construct the Binomial Distribution. 


Given 


The Higher Education Research Institute at UCLA collected data from 
203,967 incoming first-time, full-time freshmen from 270 four-year 
colleges and universities in the U.S. 71.3% of those students replied that, 
yes, they believe that same-sex couples should have the right to legal 
marital status. (Source: 
http://heri.ucla.edu/PDFs/pubs/TFS/Norms/Monographs/TheAmericanFres 
hman2011.pdf). ) 


Suppose that you randomly pick 8 first-time, full-time freshmen from the 


survey. You are interested in the number that believes that same sex-couples 
should have the right to legal marital status 


Interpret the Data 


Exercise: 


Problem: In words, define the random Variable X. 


Solution: 


X= the number that reply “yes” 


Exercise: 


Problem: X~ 


Solution: 
B(8,0.713) 


Exercise: 


Problem: What values does the random variable X take on? 


Solution: 
0,1,2.5:4:5;6;7,8 


Exercise: 


Problem: Construct the probability distribution function (PDF). 


Exercise: 


Problem: 


On average (u), how many would you expect to answer yes? 


Solution: 


D7 


Exercise: 


Problem: What is the standard deviation (c) ? 


Solution: 


1.28 
Exercise: 


Problem: 


What is the probability that at most 5 of the freshmen reply “yes”? 


Solution: 


0.4151 
Exercise: 


Problem: 
What is the probability that at least 2 of the freshmen reply “yes”? 
Solution: 


0.9990 
Exercise: 


Problem: 


Construct a histogram or plot a line graph. Label the horizontal and 
vertical axes with words. Include numerical scaling. 


Practice 3: Poisson Distribution 
This module provides further practices and exercises on Poisson 
Distribution in statistics. 


Student Learning Outcomes 


e The student will analyze the properties of a Poisson distribution. 


Given 


On average, eight teens in the U.S. die from motor vehicle injuries per day. 
As a result, states across the country are debating raising the driving age. 
(Source: 
http://www.cdc.gov/Motorvehiclesafety/Teen_Drivers/teendrivers_factsheet. 
html) ) 


Interpret the Data 


Exercise: 


Problem: 


Assume the event occurs independently in any given day. In words, 
define the Random Variable X. 


Exercise: 


Problem: X ~ 


Solution: 


P(8) 


Exercise: 


Problem: What values does X take on? 


Solution: 


O12 BA. 
Exercise: 


Problem: 


For the given values of the random variable X, fill in the 
corresponding probabilities. 


Exercise: 


Problem: 


Is it likely that there will be no teens killed in the U.S. from motor 
vehicle injuries on any given day? Justify your answer numerically. 


Solution: 


No 
Exercise: 


Problem: 


Is it likely that there will be more than 20 teens killed in the U.S. from 
motor vehicle injuries on any given day? Justify your answer 
numerically. 


Solution: 


No 


Practice 4: Geometric Distribution 
This module provides further practice with topics of Geometric Distribution 
in Statistics. 


Student Learning Outcomes 


e The student will analyze the properties of a geometric distribution. 


Given: 
Use the information from the Binomial Distribution Practice shown below. 


The Higher Education Research Institute at UCLA collected data from 
203,967 incoming first-time, full-time freshmen from 270 four-year 
colleges and universities in the U.S. 71.3% of those students replied that, 
yes, they believe that same-sex couples should have the right to legal 
marital status. (Source: 
http://heri.ucla.edu/PDFs/pubs/TFS/Norms/Monographs/TheAmericanFres 
hman2011.pdf) 


Suppose that you randomly select freshman from the study until you find 


one who replies “yes.” You are interested in the number of freshmen you 
must ask. 


Interpret the Data 


Exercise: 


Problem: In words, define the Random Variable X. 


Exercise: 


Problem: X ~ 


Solution: 


G(0.713) 


Exercise: 


Problem: What values does the random variable X take on? 


Solution: 


12.2: 
Exercise: 


Problem: 


Construct the probability distribution function (PDF). Stop at z = 6. 


Exercise: 


Problem: 


On average(j), how many freshmen would you expect to have to ask 
until you found one who replies "yes?" 


Solution: 


1 
Exercise: 


Problem: 


What is the probability that you will need to ask fewer than 3 
freshmen? 


Solution: 


0.9176 
Exercise: 


Problem: 


Construct a histogram or plot a line graph. Label the horizontal and 
vertical axes with words. Include numerical scaling. 


Practice 5: Hypergeometric Distribution 
This module provides further practice and exercises on Hypergeometric 
Distribution in statistics 


Student Learning Outcomes 


e The student will analyze the properties of a hypergeometric 
distribution. 


Given 
Suppose that a group of statistics students is divided into two groups: 
business majors and non-business majors. There are 16 business majors in 


the group and 7 non-business majors in the group. A random sample of 9 
students is taken. We are interested in the number of business majors in the 


group. 
Interpret the Data 


Exercise: 


Problem: In words, define the Random Variable X. 


Exercise: 


Problem: X ~ 
Solution: 


H(16,7,9) 


Exercise: 


Problem: What values does X take on? 


Solution: 


2,3,4,5,6,7,8,9 
Exercise: 


Problem: 


Construct the probability distribution function ( ) for X. 


Exercise: 


Problem: 
On average(j), how many would you expect to be business majors? 
Solution: 


6.26 


Discrete Random Variables Homework Link (Collaborative Statistics; R. 
Bloom custom version) 


Link to homework questions in Homework Collection/Book for Discrete 
Distributions Chapter 4 of Collaborative Statistics for R. Bloom 


Chapter 4 Review Questions Link (Collaborative Statistics; R. Bloom 
custom version) 


Link to Review Questions in Homework Collection/Book for Discrete 
Distributions Chapter 4 of Collaborative Statistics for R. Bloom 


Continuous Random Variables: Introduction (modified R. Bloom) 


Student Learning Objectives 
By the end of this chapter, the student should be able to: 


e Recognize and understand continuous probability distribution 
functions in general. 

e Recognize the uniform probability distribution and apply it 
appropriately. 

e Recognize the exponential probability distribution and apply it 
appropriately. 


Introduction 


Continuous random variables have many applications. Baseball batting 
averages, IQ scores, the length of time a long distance telephone call lasts, 
weight, height, and temperature are just a few. Generally, for continuous 
random variables, the outcomes are measured, rather than counted. The 
field of reliability depends on a variety of continuous random variables. 


Note that the values of discrete and continuous random variables can 
sometimes be ambiguous. For example, if X is equal to the number of miles 
(to the nearest mile) you drive to work then X is a discrete random variable. 
You count the miles. If X is the distance you drive to work, then you 
measure values of X and X is a continuous random variable. How the 
random variable is defined is very important. 


This chapter gives an introduction to continuous random variables and 
continuous probability distributions. There are many continuous probability 
distributions. We will be studying continuous distributions for several 
chapters and will use continuous probability throughout the rest of this 
course. We will start with the two simplest continuous distributions, the 
Uniform and the Exponential. 


Glossary 


Uniform Distribution 
Continuous random variable (RV) that appears to have equally likely 
outcomes over the domain, a < x < 6b. Often referred as Rectangular 
distribution because graph of its pdf has form of rectangle. Notation: 


X~U(a,b). The mean is p = 7°, and the variance is 0? = Usa) 
se fe ee 2 


the probability density function is f(x) = 7 ja < X <b,and 


L—a 


cumulative distribution is P(X < x) = = 


Exponential Distribution 
Continuous random variable (RV) that appears when we are interested 
in intervals of time between some random events, for example, the 
length of time between emergency arrivals at a hospital. Notation: 
X-Exp(m); the mean is 4 = ~, and the variance is 0? = a the 
probability density function is f(z) = me~™, x > Oand cumulative 
distribution is P(X <a) =1—e™*. 


Continuous Random Variables: Properties of Continuous Probability 
Distributions 


Properties of Continuous Probability Distributions 


The graph of a continuous probability distribution is a curve. Probability is 
represented by area under the curve. 


The curve is called the probability density function (abbreviated: pdf). 
We use the symbol f() to represent the curve. f(x) is the function that 
corresponds to the graph; we use the density function f(a) to draw the 
graph of the probability distribution. 


Area under the curve is given by a different function called the 
cumulative distribution function (abbreviated: cdf). The cumulative 
distribution function is used to evaluate probability as area. 


Note that the probability distribution function (pdf) and the cumulative 
distribution function (cdf) are not the same, although they are related to 
each other. 


e The entire area under the curve and above the x-axis is equal to 1. 

¢ Probability is found for intervals of X values rather than for individual 
X values. 

e P(c < X < d) is the probability that the random variable X is in the 
interval between the values c and d. P(c < X < d) is the area under 
the curve, above the x-axis, to the right of c and the left of d. 

e P(X =c) = 0 The probability that X takes on any single individual 
value is 0. The area below the curve, above the x-axis, and between 
X=c and X=c has no width, and therefore no area (area = 0). Since the 
probability is equal to the area, the probability is also 0. 


We will find the area that represents probability by using geometry, 
formulas, technology, or probability tables. In general, calculus is needed to 
find the area under the curve for many probability density functions. When 
we use formulas to find the area in this textbook, the formulas were found 
by using the techniques of integral calculus. However, because most 


students taking this course have not studied calculus, we will not be using 
calculus in this textbook. 


There are many continuous probability distributions. When using a 
continuous probability distribution to model probability, the distribution 
used is selected to best model and fit the particular situation. 


In this chapter and the next chapter, we will study the uniform distribution, 
the exponential distribution, and the normal distribution. The following 
graphs illustrate these distributions. 


Shaded Area 
represents 


P(3 < X<6) 


0123468678 9 10 X 
The Uniform Distribution 


The graph shows a Uniform 
Distribution with the area between 
X=3 and X=6 shaded to represent 

the probability that the value of 
the random variable X is in the 
interval between 3 and 6. 


Shaded Area 
represents 
P(2<X<4) 


1a &* & €@ € x 
The Exponential Distribution 


The graph shows an 
Exponential Distribution with 
the area between X=2 and X=4 
shaded to represent the 
probability that the value of the 
random variable X is in the 
interval between 2 and 4. 


Shaded area 
represents 
probability 


P(1<X<2) 


-3 -2 -1 0 1 2 3 
The Normal Distribution 


The graph shows the Standard Normal Distribution with 

the area between X=1 and X=2 shaded to represent the 

probability that the value of the random variable X is in 
the interval between 1 and 2. 


Continuous Probability Functions 

This module introduces the continuous probability function and explores 
the relationship between the probability of X and the area under the curve 
of f(X). 


We begin by defining a continuous probability density function. We use the 
function notation f(z). Intermediate algebra may have been your first 
formal introduction to functions. In the study of probability, the functions 
we study are special. We define the function f(x) so that the area between 
it and the x-axis is equal to a probability. Since the maximum probability is 
one, the maximum area is also one. 


For continuous probability distributions, PROBABILITY = AREA. 


Example: 
Consider the function f(x) = _ for 0 < x < 20. x = areal number. The 
graph of f(x) = = is a horizontal line. However, since 0 < z < 20, 


f(a) is restricted to the portion between x = 0 and x = 20, inclusive . 


] 
f(x) =— 
: 20 


> 


i) — an for 0< x <20. 
The graph of f(x) = 36 is a horizontal line segment when 0 < x < 20. 


The area between f(x) = ao where 0 < x < 20 and the x-axis is the area 
of a rectangle with base = 20 and height =3. 

AREA = 20-3 =1 

This particular function, where we have restricted x so that the area 
between the function and the x-axis is 1, is an example of a continuous 
probability density function. It is used as a tool to calculate probabilities. 
Suppose we want to find the area between f(x) = — and the x-axis 


where 0 < xz < 2. 


P| 
20 3 


NBCU es (0 10))) 2 ee (0) 

(2 — 0) = 2 = base of a rectangle 

35 = the height. 

The area corresponds to a probability. The probability that x is between 0 
and 2 is 0.1, which can be written mathematically as 

IE se) = EA ee 7))) = (0) IL. 

Suppose we want to find the area between f(x) = — and the x-axis 
where 4< 24 < 15. 


AREA = (15 — 4) - 3 = 0.55 

(15 — 4) = 11 = the base of a rectangle 

30 = the height. 

The area corresponds to the probability P(4 < 2 < 15) = 0.55. 
Suppose we want to find P(x =15 ). On an x-y graph, x=15 is a vertical 


line. A vertical line has no width (or 0 width). Therefore, 
P(x=15) = (base) (height) = (0) (55) = 0. 


f(x) 


P(X < «) (can be written as P(X < x) for continuous distributions) is 
called the cumulative distribution function or CDF. Notice the "less than 
or equal to" symbol. We can use the CDF to calculate P(X > x) . The 
CDF gives "area to the left" and P(X > x) gives "area to the right." We 
calculate P(X > x) for continuous distributions as follows: 

VA ie | I ZIO.G ce ta), 


f(x) 


x 
P(X < x) P(X > x) = 1-P(X < x) 


Label the graph with f(x) and . Scale the x and y axes with the maximum 


x and y values. f(x) = = 0<2 < 20. 


f(x) 


0 2.3 12.7 x 


P(2.3 < @ < 12.7) = (base)(height) = (12.7 — 2.3) (4) = 0.52 


The Uniform Distribution (modified R. Bloom) 

This module examines the properties of the continuous Uniform probability distribution, which describes a 
set of continuous data for which all intervals of values having the same length are equally likely. This 
revision is based on the original module m16819 in the textbook collection Collaborative Statistics by S. 
Dean and Dr. B. Illowsky; the last example in the original module was replaced with a new example. 


Example: 
Illustrate the uniform distribution. The data that follows are a random sample of 55 smiling times, in 
seconds, of an eight-week old baby. 


10.4 19.6 18.8 13.9 17.8 16.8 21.6 17.9 IDES 11.1 4.9 
12.8 14.8 22.8 20.0 15.9 16.3 13.4 17.1 14.5 19.0 22.8 
ES 0.7 8.9 11.9 10.9 Tee) 5.9 3.7 WES 19.2 9.8 
5.8 6.9 2.6 5.8 21.7 11.8 3.4 2.1 4.5 6.3 10.7 


8.9 9.4 9.4 7.6 10.0 3.3 6.7 7.8 11.6 13.8 18.6 


sample mean = 11.49 and sample standard deviation = 6.23 

We will assume that the sample of smiling times is drawn from a population that follows a uniform 
distribution between 0 and 23 seconds. This means that any smiling time between 0 and 23 seconds is 
equally likely. 

Let X = length of time, in seconds, of an eight-week old's smile. 

The notation for the uniform distribution is 

X ~ U(a,b) where a = the lowest value and 6 = the highest value. 

For this example, X ~ U(0,23).0 < X < 23. 

Formulas for the theoretical mean and standard deviation are 


i = ot and 0 = qe 


For this problem, the theoretical mean and standard deviation are 
23—0)2 

eee = 6.64 seconds 

Notice that the theoretical mean and standard deviation are close to the sample mean and standard 

deviation. 


To find f(X): F(X) =z =4 


n= aaa = 11.50 seconds and o = 


Example: 
Exercise: 


Problem: 


What is the probability that a randomly chosen eight-week old smiles between 2 and 18 seconds? 


Solution: 
Find P(2 < X < 18). 


P(2 < X < 18) = (base)(height) = (18 -— 2)- = = 3. 


L 
23 


f(X) 


0 2 18 23 


Exercise: 


Problem: Find the 90th percentile for an eight week old's smiling time. 

Solution: 

Ninety percent of the smiling times fall below the 90th percentile, k, so P(X < k) = 0.90 
P(X =k) — 0:90 

(base) (height) = 0.90 

(k — 0) - 3 =0.90 


= 23 - 0.90 = 20.7 


f(X) AREA = P(X <k) = 0.90 


Exercise: 
Problem 3 is OPTIONAL: Conditional Probability 


Problem: 


Find the probability that a random eight week old smiles more than 12 seconds KNOWING that the 
baby smiles MORE THAN 8 SECONDS. 


Solution: 
Find P(X > 12|X > 8) There are two ways to do the problem. For the first way, use the fact that 


this is a conditional and changes the sample space. The graph illustrates the new sample space. You 
already know the baby smiled more than 8 seconds. 


Write anew f(X): f(X) =s4,5 =+ 
for 8 < X < 23 


P(X > 12|X > 8) = (23-12)- =H 


8 12 23 
Xx 


For the second way, use the conditional formula from Chapter 3 with the original distribution X ~ 
U(0, 23): 


P(A|B) = ee For this problem, A is (X > 12) and Bis (X > 8). 


So, P(X > 12|X > 8) = ENS) _ ee = = = 0.733 


02 4 6 8 10 1214 16 18 20 22 24 
X 


Example: 

Uniform: The amount of time, in minutes, that a person must wait for a bus is uniformly distributed 
between 0 and 15 minutes. 

Exercise: 


Problem: What is the probability that a person waits fewer than 12.5 minutes? 
Solution: 


Let X = the number of minutes a person must wait for a bus. a = 0 and b= 15. X~U(0, 15). Write 


the probability density function. f(X) = <1. = + for0 < X < 15 
15-0” 15 


Find P(X < 12.5). Draw a graph. 


P(X < k) = (base)(height) = (12.5 — 0) - = = 0.8333 


The probability a person waits less than 12.5 minutes is 0.8333. 


£(X) 


Exercise: 


Problem: On the average, how long must a person wait? 


Find the mean, yp, and the standard deviation, o. 


Solution: 
Lb aoe Bie 7.5. On the average, a person must wait 7.5 minutes. 
(15-0)? Meee ; 
G= =p = 4.3. The Standard deviation is 4.3 minutes. 
Exercise: 


Problem: Ninety percent of the time, the time a person must wait falls below what value? 


Note:This asks for the 90th percentile. 


Solution: 

Find the 90th percentile. Draw a graph. Let k = the 90th percentile. 
P(X < k) = (base)(height) = (k — 0) - (+z) 

090 =k: ik 

k= (0:90)(15) = 135 

k is sometimes called a critical value. 


The 90th percentile is 13.5 minutes. Ninety percent of the time, a person must wait at most 13.5 
minutes. 


AREA = P(X <k) = 0.90 


Example: 

Uniform: Ace Heating and Air Conditioning Service finds that the amount of time a repairman needs to 
fix a furnace is uniformly distributed between 1.5 and 4 hours. Let X = the time needed to fix a furnace. 
Then X ~ U(1.5, 4). 


1. Find the problem that a randomly selected furnace repair requires more than 2 hours. 

2. Find the probability that a randomly selected furnace repair requires less than 3 hours. 

3. Find the 30th percentile of furnace repair times. 

4. The longest 25% of repair furnace repairs take at least how long? (In other words: Find the minimum 
time for the longest 25% of repair times.) What percentile does this represent? 

5. Find the mean and standard deviation 


Exercise: 


Problem: Find the probability that a randomly selected furnace repair requires longer than 2 hours. 


Solution: 


Tomindh (0) 6) oe 
P(X>2) = (base)(height) = (4 — 2)(0.4) = 0.8 
Example 4 Figure 1 

P(X>2) 


f(x)=0.4 


Uniform Distribution 
between 1.5 and 4 with 
shaded area between 2 and 4 
representing the probability 
that the repair time X is 
greater than 2 


Exercise: 


Problem: 


Find the probability that a randomly selected furnace repair requires less than 3 hours. Describe how 
the graph differs from the graph in the first part of this example. 


Solution: 
P(X < 3) = (base)(height) = (3 — 1.5)(0.4) = 0.6 


The graph of the rectangle showing the entire distribution would remain the same. However the 
graph should be shaded between X=1.5 and X=3. Note that the shaded area starts at X=1.5 rather 
than at X=0; since X~U(1.5,4), X can not be less than 1.5. 
Example 4 Figure 2 

P(X<3) 


f(x)=0.4 


0 11.5 2 3 i 


Uniform Distribution 
between 1.5 and 4 with 
shaded area between 1.5 and 
3 representing the probability 
that the repair time X is less 
than 3 


Exercise: 


Problem: Find the 30th percentile of furnace repair times. 


Solution: 
Example 4 Figure 3 
Area=0.3 
P(X<k) = 0.3 
f(x) =0.4 
X 
0 15 «k 4 


Uniform Distribution between 

1.5 and 4 with an area of 0.30 

shaded to the left, representing 
the shortest 30% of repair times. 


P(X < k) =0.30 


P(X < k) = (base) (height) = (& — 1.5) - (0.4) 


e 0.3 = (k — 1.5) (0.4) ; Solve to find k: 
e 0.75 =k-— 1.5, obtained by dividing both sides by 0.4 
e k=2.25, obtained by adding 1.5 to both sides 
The 30th percentile of repair times is 2.25 hours. 30% of repair times are 2.5 hours or less. 
Exercise: 
Problem: 


The longest 25% of furnace repair times take at least how long? (Find the minimum time for the 
longest 25% of repairs.) 


Solution: 
Example 4 Figure 4 


Area= 0.25 
P(X>k)=0.25 


X 


0 1.5 k 4 


Uniform Distribution 
between 1.5 and 4 with an 
area of 0.25 shaded to the 

right representing the 

longest 25% of repair times. 


ROS k 020 
P(X > k) = (base)(height) = (4 — k) - (0.4) 
e 0.25 = (4 — k)(0.4) ; Solve for k: 
e 0.625 = 4-k, obtained by dividing both sides by 0.4 
e —3.375 =—-k , obtained by subtracting 4 from both sides 
e k=3.375 
The longest 25% of furnace repairs take at least 3.375 hours (3.375 hours or longer). 


Note: Since 25% of repair times are 3.375 hours or longer, that means that 75% of repair times are 
3.375 hours or less. 3.375 hours is the 75th percentile of furnace repair times. 


Exercise: 


Problem: Find the mean and standard deviation 


Solution: 


— aye ando = ny ee 


y= 1544 — 2.75 hours and o = ee = 0.7217 hours 


Note:See "Summary of the Uniform and Exponential Probability Distributions" for a full summary. 


Glossary 


Conditional Probability 
The likelihood that an event will occur given that another event has already occurred. 


Uniform Distribution 
Continuous random variable (RV) that appears to have equally likely outcomes over the domain, 


a < « < b. Often referred as Rectangular distribution because graph of its pdf has form of 
(b=a)? 


rectangle. Notation: X~U(a,b). The mean is = ait and the variance is 0? = +S", the 
probability density function is f(x) = = ja < X <b, and cumulative distribution is 


P(X<2)= £2. 


The Exponential Distribution 
This module introduces the properties of the exponential distribution, the behavior of probabilities that reflect a 
large number of small values and a small number of high values. 


The exponential distribution is often concerned with the amount of time until some specific event occurs. For 
example, the amount of time (beginning now) until an earthquake occurs has an exponential distribution. Other 
examples include the length, in minutes, of long distance business telephone calls, and the amount of time, in 
months, a car battery lasts. It can be shown, too, that the value of the change that you have in your pocket or 
purse approximately follows an exponential distribution. 


Values for an exponential random variable occur in the following way. There are fewer large values and more 
small values. For example, the amount of money customers spend in one trip to the supermarket follows an 
exponential distribution. There are more people that spend less money and fewer people that spend large 
amounts of money. 


The exponential distribution is widely used in the field of reliability. Reliability deals with the amount of time a 
product lasts. 


Example: 

Illustrates the exponential distribution: Let X = amount of time (in minutes) a postal clerk spends with 
his/her customer. The time is known to have an exponential distribution with the average amount of time equal 
to 4 minutes. 

X is a continuous random variable since time is measured. It is given that jz = 4 minutes. To do any 
calculations, you must know m, the decay parameter. 

i. = = Therefore, m = t = (5 

The standard deviation, o, is the same as the mean. pp = 0 

The distribution notation is X~Exp(m). Therefore, X~Exp(0.25). 

The probability density function is f(a) = m-e™* The number e = 2.71828182846... It is a number that is 
used often in mathematics. Scientific calculators have the key "e*." If you enter 1 for z, the calculator will 
display the value e. 

The curve is: 

Hi) = 0.25 - e~ °-5* where z is at least 0 and m = 0.25. 

For example, f(8) = 0.25-e 9755 — 9.072 


The graph is as follows: 
f(x) 
0.25, m= 0.25 
0.27 ' 
0.157 
0.1) \ 
0.05 i : 
O}—4+4 ++ +4 4 4H 
02 4 6 8 101214161820 
x 
w=4 


Notice the graph is a declining curve. When z = 0, 
Vc OO Gc etre. 0.250.257 


Example: 
Exercise: 


Problem: Find the probability that a clerk spends four to five minutes with a randomly selected customer. 
Solution: 

Find P(4 < x < 5). 

The cumulative distribution function (CDF) gives the area to the left. 

Pat) = 

P@ 25) =) —e* — 07135 and P(e <4) — 1 eo — 0.6321 


f(x) P(4 < x <5) 
0.25 


Note: You can do these calculations easily on a calculator. 


The probability that a postal clerk spends four to five minutes with a randomly selected customer is 


P(4 <a <5) = P(a <5) — P(x < 4) = 0.7135 — 0.6321 = 0.0814 


Note: TI-83+ and TI-84: On the home screen, enter (1-e/((-.25*5))-(1-e/(-.25*4)) or enter eA(-.25*4)- 
eA(-.25*5),. 


Exercise: 


Problem: Half of all customers are finished within how long? (Find the 50th percentile) 


Solution: 


Find the 50th percentile. 


f(x) P(x <k)=0.50 


P(a < k) = 0.50, & = 2.8 minutes (calculator or computer) 
Half of all customers are finished within 2.8 minutes. 

You can also do the calculation as follows: 

P(e <k) = 0.50 and P(e <k) =1—e9?** 

Therefore, 0.50 = 1 — e 9° and e °5* = 1 — 0.50 = 0.5 


Take natural logs: In(e~°?°*) = In(0.50). So, —0.25-k = In(0.50) 


In(.50) 
~0.25 


Solve for k: k = = 2.8 minutes 


LN(1—AreaToTheLeft) 


—m 


Note:A formula for the percentile k is k = where LN is the natural log. 


Note: TI-83+ and TI-84: On the home screen, enter LN(1-.50)/-.25. Press the (-) for the negative. 


Exercise: 


Problem: Which is larger, the mean or the median? 
Solution: 
Is the mean or median larger? 


From part b, the median or 50th percentile is 2.8 minutes. The theoretical mean is 4 minutes. The mean is 
larger. 


Optional Collaborative Classroom Activity 


Have each class member count the change he/she has in his/her pocket or purse. Your instructor will record the 
amounts in dollars and cents. Construct a histogram of the data taken by the class. Use 5 intervals. Draw a 
smooth curve through the bars. The graph should look approximately exponential. Then calculate the mean. 


Let X = the amount of money a student in your class has in his/her pocket or purse. 


The distribution for X is approximately exponential with mean, pz = and m = . The standard 
deviation, o = 


Draw the appropriate exponential graph. You should label the x and y axes, the decay rate, and the mean. Shade 


the area that represents the probability that one student has less than $.40 in his/her pocket or purse. (Shade 
P(x < 0.40)). 


Example: 


On the average, a certain computer part lasts 10 years. The length of time the computer part lasts is 
exponentially distributed. 
Exercise: 


Problem: What is the probability that a computer part lasts more than 7 years? 
Solution: 

Let x = the amount of time (in years) a computer part lasts. 

= 10som= = = + —0.1 

Find P(« > 7). Draw a graph. 

Pia) — 1 P(e): 

Since P(X <2) = 1 —e" ther P(X >a) =1—(l—2e" *)=e"" 


2S) — e917 — 0.4966. The probability that a computer part lasts more than 7 years is 0.4966. 


Note: TI-83+ and TI-84: On the home screen, enter e/(-.1*7). 


f(x) P(x > 7) 
0.1 
0 7 x 
u= 10 
Exercise: 


Problem: On the average, how long would 5 computer parts last if they are used one after another? 


Solution: 


On the average, 1 computer part lasts 10 years. Therefore, 5 computer parts, if they are used one right after 
the other would last, on the average, 


(5)(10) = 50 years. 

Exercise: 
Problem: Eighty percent of computer parts last at most how long? 
Solution: 


Find the 80th percentile. Draw a graph. Let & = the 80th percentile. 


f(x) P(x < k) = 0.80 
0.1 


In(1-.80) 


Solve for k: k = —>y 


= 16.1 years 


Eighty percent of the computer parts last at most 16.1 years. 


Note: TI-83+ and TI-84: On the home screen, enter LN(1 - .80)/-.1 


Exercise: 


Problem: What is the probability that a computer part lasts between 9 and 11 years? 
Solution: 


Find P(9 < « < 11). Drawa graph. 


f(x) PQ <x<11) 
0.1 


P(Q < a < 11) = P(x < 11) — P(@ < 9) = (1—e °™) — (1-e ©*”) = 0.6671 — 0.5934 = 0.0737 
. (calculator or computer) 


The probability that a computer part lasts between 9 and 11 years is 0.0737. 


Note: TI-83+ and TI-84: On the home screen, enter e/(-.1*9) - e\(-.1*11). 


Example: 
Suppose that the length of a phone call, in minutes, is an exponential random variable with decay parameter = 


> If another person arrives at a public telephone just before you, find the probability that you will have to 
wait more than 5 minutes. Let X = the length of a phone call, in minutes. 
Exercise: 


Problem: What is m, jz, and o? The probability that you must wait more than 5 minutes is 


Solution: 


P(x > 5) = 0.6592 


Note:A summary for exponential distribution is available in "Summary of The Uniform and Exponential 
Probability Distributions". 


Glossary 


Exponential Distribution 
A continuous random variable (RV) that appears when we are interested in the intervals of time between 
some random events, for example, the length of time between emergency arrivals at a hospital. Notation: 
X~Exp(m). The mean is pp = = and the standard deviation is 0 = 4. The probability density function is 


f(x) =me"™, x > 0 and the cumulative distribution function is P(X < «) = 1—e™™. 


Summary of the Uniform and Exponential Probability Distributions 

This module provides a summary of formulas and definitions related to Continuous Random 
Variables. 

Formula 

Uniform 


X =a real number between a and b (in some instances, X can take on the values a and 6). a = 
smallest X ; b = largest X 


X ~U(a,b) 


The mean is pp = ate 


rar (b—a)? 
The standard deviation is o = 5 


Probability density function: f(X) = j+- fora < X <b 


Area to the Left of x: P(X < x) = (base) (height) 
Area to the Right of x: P(X > x) = (base) (height) 


Area Between c and d: P(c < X < d) = (base)(height) = (d — c)(height). 
Formula 
Exponential 


X ~ Exp(m) 

X =a real number, 0 or larger. m = the parameter that controls the rate of decay or decline 
The mean and standard deviation are the same. 

pao= ay and m = = - 

The probability density function: f(x ) =m-e™% X >0 
Area to the Left of x: P(X < x) =1—e™* 

Area to the Right of x: P(X > x) = e™* 


Area Between c and d: 
P(e< X<d)=P(X <d)—-P(X <c)=(1-e ™)-(l1-e ™)=e™-e™ 


LN(1-AreaToTheLeft) 


Percentile, k: k = a 


Continuous Random Variables: Practice 1 (modified R. Bloom) 


Student Learning Outcomes 


e The student will explore the properties of data with a uniform 
distribution. 


Given 


The age of cars in the staff parking lot of a suburban college is uniformly 
distributed from six months (0.5 years) to 9.5 years. 


Describe the Data 


Exercise: 


Problem: What is being measured here? 


Solution: 


The age of cars in the staff parking lot 


Exercise: 


Problem: In words, define the Random Variable X. 


Solution: 


X = The age (in years) of cars in the staff parking lot 


Exercise: 


Problem: Are the data discrete or continuous? 


Solution: 


Continuous 


Exercise: 


Problem: The interval of values for X is: 


Solution: 


0:5: 4955 


Exercise: 


Problem: The distribution for X is: 


Solution: 


X ~U(0.5,9.5) 


Probability Distribution 


Exercise: 


Problem: Write the probability density function. 


Solution: 


Exercise: 


Problem: Graph the probability distribution. 


e aSketch the graph of the probability distribution. 


e bldentify the following values: 


iLowest value for X: 
iiHighest value for X: 
iiiHeight of the rectangle: 
ivLabel for x-axis (words): 
vLabel for y-axis (words): 


oOo 0 0 0 


Solution: 


e b.i0.5 
e b.ii9.5 
e b.iiiAge of Cars 
° b.ivy 


e bv f(z) 


Random Probability 


Exercise: 


Problem: 


Find the probability that a randomly chosen car in the lot was less than 
4 years old. 


e aSketch the graph. Shade the area of interest. 


e bFind the probability. P(X < 4) = 


Solution: 


3.5 
e b. 9 


Quartiles 


Exercise: 


Problem: Find the average age of the cars in the lot. 
Solution: 


b=5 
Exercise: 
Problem: 
Find the third quartile of ages of cars in the lot. This means you will 


have to find the value such that 3, or 75%, of the cars are at most (less 
than or equal to) that age. 


e aSketch the graph. Shade the area of interest. 


e bFind the value k such that P(X < k) = 0.75. 
e clhe third quartile is: 


Solution: 


¢ bk = 7.25 


Practice 2: Exponential Distribution 
In this module the student will explore the properties of data with an 
exponential distribution. 


Student Learning Outcomes 


e The student will analyze data following the exponential distribution. 


Given 
Carbon-14 is a radioactive element with a half-life of about 5730 years. 
Carbon-14 is said to decay exponentially. The decay rate is 0.000121 . We 


start with 1 gram of carbon-14. We are interested in the time (years) it takes 
to decay carbon-14. 


Describe the Data 


Exercise: 


Problem: What is being measured here? 


Exercise: 


Problem: Are the data discrete or continuous? 


Solution: 


Continuous 


Exercise: 


Problem: In words, define the Random Variable X. 


Solution: 


X = Time (years) to decay carbon-14 


Exercise: 


Problem: What is the decay rate (m)? 


Solution: 


m = 0.000121 


Exercise: 


Problem: The distribution for X is: 


Solution: 


X ~ Exp(0.000121) 


Probability 


Exercise: 


Problem: 


Find the amount (percent of 1 gram) of carbon-14 lasting less than 
5730 years. This means, find P(x < 5730). 


e aSketch the graph. Shade the area of interest. 


¢ bFind the probability. P(a < 5730) = 


Solution: 


¢ bP(x < 5730) = 0.5001 
Exercise: 
Problem: 
Find the percentage of carbon-14 lasting longer than 10,000 years. 


e aSketch the graph. Shade the area of interest. 


e bFind the probability. P(2 > 10000) = 


Solution: 
¢ bP(x > 10000) = 0.2982 
Exercise: 
Problem: 
Thirty percent (30%) of carbon-14 will decay within how many years? 


e aSketch the graph. Shade the area of interest. 


e bFind the value k such that P(x < k) = 0.30. 


Solution: 


¢ bk = 2947.73 


Continuous Distributions Homework Link (Collaborative Statistics; R. 
Bloom custom version) 


Link to homework questions in Homework Collection/Book for Continuous 
Distributions Chapter 5 of Collaborative Statistics for R. Bloom 


Chapter 5 Review Questions Link (Collaborative Statistics; R. Bloom 
custom version) 


Link to Review Questions in Homework Collection/Book for Continuous 
Distributions Chapter 5 of Collaborative Statistics for R. Bloom 


Chapter 5 Review Questions (_http://cnx.org/content/m19020/latest/_) 


The Normal Distribution 


Student Learning Outcomes 
By the end of this chapter, the student should be able to: 


e Recognize the normal probability distribution and apply it 
appropriately. 

e Recognize the standard normal probability distribution and apply it 
appropriately. 

e Compare normal probabilities by converting to the standard normal 
distribution. 


Introduction 


The normal, a continuous distribution, is the most important of all the 
distributions. It is widely used and even more widely abused. Its graph is 
bell-shaped. You see the bell curve in almost all disciplines. Some of these 
include psychology, business, economics, the sciences, nursing, and, of 
course, mathematics. Some of your instructors may use the normal 
distribution to help determine your grade. Most IQ scores are normally 
distributed. Often real estate prices fit a normal distribution. The normal 
distribution is extremely important but it cannot be applied to everything in 
the real world. 


In this chapter, you will study the normal distribution, the standard normal, 
and applications associated with them. 


Optional Collaborative Classroom Activity 


Your instructor will record the heights of both men and women in your 
class, separately. Draw histograms of your data. Then draw a smooth curve 
through each histogram. Is each curve somewhat bell-shaped? Do you think 
that if you had recorded 200 data values for men and 200 for women that 
the curves would look bell-shaped? Calculate the mean for each data set. 
Write the means on the x-axis of the appropriate graph below the peak. 


Shade the approximate area that represents the probability that one 
randomly chosen male is taller than 72 inches. Shade the approximate area 
that represents the probability that one randomly chosen female is shorter 
than 60 inches. If the total area under each curve is one, does either 
probability appear to be more than 0.5? 


The normal distribution has two parameters (two numerical descriptive 
measures), the mean (jz) and the standard deviation (a). If X is a quantity to 
be measured that has a normal distribution with mean (jz) and the standard 
deviation (a), we designate this by writing 


NORMAL: X~N(u, 0) 


The probability density function is a rather complicated function. Do not 
memorize it. It is not necessary. 


f(e) =e HON 


The cumulative distribution function is P(X < 2) . It is calculated either 
by a calculator or a computer or it is looked up in a table. Technology has 
made the tables basically obsolete. For that reason, as well as the fact that 
there are various table formats, we are not including table instructions in 
this chapter. See the NOTE in this chapter in Calculation of Probabilities. 


The curve is symmetrical about a vertical line drawn through the mean, u. 
In theory, the mean is the same as the median since the graph is symmetric 
about pt. As the notation indicates, the normal distribution depends only on 
the mean and the standard deviation. Since the area under the curve must 


equal one, a change in the standard deviation, 0, causes a change in the 
shape of the curve; the curve becomes fatter or skinnier depending on o. A 
change in pt causes the graph to shift to the left or right. This means there 
are an infinite number of normal probability distributions. One of special 
interest is called the standard normal distribution. 


Glossary 


Normal Distribution 


A continuous random variable (RV) with pdf 
2 
f(x) = —he~(-w)’/20"| where ps is the mean of the distribution and 
ov 2n 


o is the standard deviation. Notation: X ~ N(y, 0). If w = 0 and 
o = 1, the RV is called the standard normal distribution. 


The Standard Normal Distribution 


The standard normal distribution is a normal distribution of 
standardized values called z-scores. A z-score is measured in units of 
the standard deviation. For example, if the mean of a normal distribution 
is 5 and the standard deviation is 2, the value 11 is 3 standard deviations 
above (or to the right of) the mean. The calculation is: 

Equation: 


The z-score is 3. 


The mean for the standard normal distribution is 0 and the standard 
deviation is 1. The transformation 


z= =* produces the distribution Z~ N(0,1) —. The value x comes 


from a normal distribution with mean p and standard deviation o. 


Glossary 


Standard Normal Distribution 
A continuous random variable (RV) X~N(0,1 ).. When X follows the 
standard normal distribution, it is often noted as Z~N(0,1). 


z-score 
The linear transformation of the form z = =. If this transformation 
is applied to any normal distribution X~N(,c) , the result is the 
standard normal distribution Z~N (0,1). If this transformation is 
applied to any specific value x of the RV with mean p and standard 
deviation o , the result is called the z-score of x. Z-scores allow us to 
compare data that are normally distributed but scaled differently. 


Z-Scores 


If X is a normally distributed random variable and X~N(u, o), then the z- 
score is: 
Equation: 


The z-score tells you how many standard deviations that the value z is 
above (to the right of) or below (to the left of) the mean, jz. Values of z 
that are larger than the mean have positive z-scores and values of x that are 
smaller than the mean have negative z-scores. If x equals the mean, then x 
has a z-score of 0. 


Example: 

Suppose X ~ N(5, 6). This says that X is a normally distributed random 
variable with mean pp = 5 and standard deviation o = 6. Suppose x = 17. 
Then: 

Equation: 


This means that x = 17 is 2 standard deviations (20) above or to the 
right of the mean pt = 5. The standard deviation is o = 6. 

Notice that: 

Equation: 


Do 2 16 —vls, (The pattern is + zo = 2.) 


Now suppose x=1. Then: 
Equation: 


= ie 
= —- = —0.67 (rounded to two decimal places) 
o 


This means that x = 1 is 0.67 standard deviations (- 0.670) below or to 
the left of the mean pi = 5. Notice that: 

5 + (—0.67)(6) is approximately equal to 1 (This has the pattern 
p+ (—0.67)o = 1) 

Summarizing, when z is positive, x is above or to the right of and when 
zis negative, x is to the left of or below p. 


Example: 

Some doctors believe that a person can lose 5 pounds, on the average, in a 
month by reducing his/her fat intake and by exercising consistently. 
Suppose weight loss has a normal distribution. Let X = the amount of 
weight lost (in pounds) by a person in a month. Use a standard deviation of 
2 pounds. X~N(5, 2). Fill in the blanks. 

Exercise: 


Problem: 


Suppose a person lost 10 pounds in a month. The z-score when 
x = 10 pounds is z = 2.5 (verify). This z-score tells you that x = 10 


is standard deviations to the (right or left) of the 
mean (What is the mean?). 
Solution: 


This z-score tells you that x = 10 is 2.5 standard deviations to the 
right of the mean 5. 


Exercise: 
Problem: 
Suppose a person gained 3 pounds (a negative weight loss). Then z = 


. This z-score tells you that x = -3 is standard 
deviations to the (right or left) of the mean. 


Solution: 


= -4. This z-score tells you that x = -3 is 4 standard deviations to 
the left of the mean. 
Suppose the random variables X and Y have the following normal 
distributions: X ~N(5, 6) and Y ~ N(2, 1). Ifx = 17, then z = 2. (This 
was previously shown.) If y = 4, what is z? 
Equation: 


= SS where p}=2 and o=1. 


The z-score for y = 4 is z = 2. This means that 4 is z = 2 standard 
deviations to the right of the mean. Therefore, x = 17 and y = 4 are both 2 
(of their) standard deviations to the right of their respective means. 

The z-score allows us to compare data that are scaled differently. To 
understand the concept, suppose X ~N(5, 6) represents weight gains for 
one group of people who are trying to gain weight in a 6 week period and 
Y ~N(2, 1) measures the same weight gain for a second group of people. 
A negative weight gain would be a weight loss. Since x = 17 and y = 4 
are each 2 standard deviations to the right of their means, they represent 
the same weight gain relative to their means. 


The Empirical Rule 
If X is arandom variable and has a normal distribution with mean p and 
standard deviation o then the Empirical Rule says (See the figure below) 


e About 68.27% of the x values lie between -1o0 and +10 of the mean p 
(within 1 standard deviation of the mean). 

e About 95.45% of the x values lie between -20 and +20 of the mean p 
(within 2 standard deviations of the mean). 

e About 99.73% of the x values lie between -30 and +30 of the mean p 
(within 3 standard deviations of the mean). Notice that almost all the x 
values lie within 3 standard deviations of the mean. 

e The z-scores for +1o and —1o are +1 and -1, respectively. 

e The z-scores for +20 and —2o0 are +2 and -2, respectively. 

e The z-scores for +30 and —3a0 are +3 and -3 respectively. 


xX 
—30-—20-lo wp lo 20 30 


The Empirical Rule is also known as the 68-95-99.7 Rule. 


Example: 


Suppose X has a normal distribution with mean 50 and standard deviation 
6. 


e About 68.27% of the x values lie between -1o = (-1)(6) = -6 and lo = 
(1)(6) = 6 of the mean 50. The values 50 - 6 = 44 and 50 + 6 = 56 are 
within 1 standard deviation of the mean 50. The z-scores are -1 and 
+1 for 44 and 56, respectively. 

e About 95.45% of the x values lie between -20 = (-2)(6) = -12 and 20 
= (2)(6) = 12 of the mean 50. The values 50 - 12 = 38 and 50 + 12 = 
62 are within 2 standard deviations of the mean 50. The z-scores are 
-2 and 2 for 38 and 62, respectively. 

e About 99.73% of the x values lie between -3o0 = (-3)(6) = -18 and 30 
= (3)(6) = 18 of the mean 50. The values 50 - 18 = 32 and 50 + 18 = 
68 are within 3 standard deviations of the mean 50. The z-scores are 
-3 and +3 for 32 and 68, respectively. 


Normal Distribution: Areas to the Left and Right of x 
The arrow in the graph below points to the area to the left of x. This area is 


represented by the probability P(X < x). Normal tables, computers, and 
calculators provide or calculate the probability P(X < 2). 


P(X <x) 


X 
X 


The area to the right is then P(X > x) = 1— P(X <2). 
Remember, P(X < x) = Area to the left of the vertical line through z. 


P(X >a) =1-— P(X < a) =. Area to the right of the vertical line 
through x 


P(X < 2) is the same as P(X < x) and P(X > z) is the same as 
P(X > a) for continuous distributions. 


Calculations of Probabilities 


Probabilities are calculated by using technology. There are instructions in 
the chapter for the TI-83+ and TI-84 calculators. 


Note:In the Table of Contents for Collaborative Statistics, entry 15. 
Tables has a link to a table of normal probabilities. Use the probability 
tables if so desired, instead of a calculator. The tables include instructions 
for how to use then. 


Example: 
If the area to the left is 0.0228, then the area to the right is 
1 — 0.0228 = 0.9772. 


Example: 

The final exam scores in a statistics class were normally distributed with a 
mean of 63 and a standard deviation of 5. 

Exercise: 


Problem: 


Find the probability that a randomly selected student scored more than 
65 on the exam. 


Solution: 


Let X = ascore on the final exam. X~N(63, 5), where ps = 63 and 
(5) 


Draw a graph. 


Then, find P(« > 65). 


P(x > 65) = 0.3446 (calculator or computer) 


0.3446 


a 


The probability that one student scores more than 65 is 0.3446. 


63 65 


Using the TI-83+ or the TI-84 calculators, the calculation is as 
follows. Go into 2nd DISTR. 


After pressing 2nd DISTR, press 2:normalcdf. 
The syntax for the instructions are shown below. 


normalcdf(lower value, upper value, mean, standard deviation) For 
this problem: normalcdf(65,1E99,63,5) = 0.3446. You get 1E99 ( = 
10°°) by pressing 1, the EE key (a 2nd key) and then 99. Or, you can 
enter 10/99 instead. The number 10% is way out in the right tail of 
the normal curve. We are calculating the area between 65 and 10°”. In 
some instances, the lower number of the area might be -1E99 ( = 
—10%). The number —10% is way out in the left tail of the normal 
curve. 


Note:The TI probability program calculates a z-score and then the 
probability from the z-score. Before technology, the z-score was 
looked up in a standard normal probability table (because the math 
involved is too cumbersome) to find the probability. In this example, 


a standard normal table with area to the left of the z-score was used. 
You calculate the z-score and look up the area to the left. The 
probability is the area to the right. 


ea S88 — 0.4 . Area to the left is 0.6554. 
(pe Oa) 0 le ood Ur ado 


Exercise: 


Problem: 


Find the probability that a randomly selected student scored less than 
85. 


Solution: 


Draw a graph. 


Then find P(x < 85). Shade the graph. P(a < 85) = 1 (calculator 
or computer) 


The probability that one student scores less than 85 is approximately 1 
(or 100%). 


The TI-instructions and answer are as follows: 


normalcdf(0,85,63,5) = 1 (rounds to 1) 
Exercise: 


Problem: 


Find the 90th percentile (that is, find the score k that has 90 % of the 
scores below k and 10% of the scores above k). 


Solution: 


Find the 90th percentile. For each problem or part of a problem, draw 
a new graph. Draw the x-axis. Shade the area that corresponds to the 
90th percentile. 


Let k = the 90th percentile. & is located on the x-axis. P(x < k) is 
the area to the left of k. The 90th percentile k separates the exam 
scores into those that are the same or lower than & and those that are 
the same or higher. Ninety percent of the test scores are the same or 
lower than & and 10% are the same or higher. k is often called a 
critical value. 


k = 69.4 (calculator or computer) 


P(x < k) = 0.90 


The 90th percentile is 69.4. This means that 90% of the test scores fall 
at or below 69.4 and 10% fall at or above. For the TI-83+ or TI-84 
calculators, use LnvNormin 2nd DISTR. invNorm(area to the left, 
mean, standard deviation) For this problem, invNorm(0.90,63,5) = 
69.4 


Exercise: 


Problem: 


Find the 70th percentile (that is, find the score k such that 70% of 
scores are below k and 30% of the scores are above k). 


Solution: 


Find the 70th percentile. 
Draw a new graph and label it appropriately. k = 65.6 


The 70th percentile is 65.6. This means that 70% of the test scores fall 
at or below 65.5 and 30% fall at or above. 


invNorm(0.70,63,5) = 65.6 


Example: 

A computer is used for office work at home, research, communication, 
personal finances, education, entertainment, social networking and a 
myriad of other things. Suppose that the average number of hours a 
household personal computer is used for entertainment is 2 hours per day. 
Assume the times for entertainment are normally distributed and the 
standard deviation for the times is half an hour. 

Exercise: 


Problem: 


Find the probability that a household personal computer is used 
between 1.8 and 2.75 hours per day. 


Solution: 


Let X = the amount of time (in hours) a household personal computer 
is used for entertainment. x~N(2, 0.5) where « = 2 and o = 0.5. 


Find P(1.8 < x < 2.75). 


The probability for which you are looking is the area between 
Les AMC aN) peel Out 2 id) OOO 


18 5 2.75. Xx 


normalcdf(1.8,2.75,2,0.5) = 0.5886 
The probability that a household personal computer is used between 
1.8 and 2.75 hours per day for entertainment is 0.5886. 
Exercise: 
Problem: 


Find the maximum number of hours per day that the bottom quartile 
of households use a personal computer for entertainment. 


Solution: 


To find the maximum number of hours per day that the bottom 
quartile of households uses a personal computer for entertainment, 
find the 25th percentile, k, where P(x < k) = 0.25. 


k= 1.67 


P(x > k) = 0.75 
P(x <k) = 0.25 ia 


invNorm(0.25,2,.5) = 1.66 


The maximum number of hours per day that the bottom quartile of 
households uses a personal computer for entertainment is 1.66 hours. 


Summary of Formulas 
Formula 
Normal Probability Distribution 


X~N(p,0) 


j = the mean o = the standard deviation 
Formula 
Standard Normal Probability Distribution 


Z~N(0, 1) 
z = a Standardized value (z-score) 


mean = 0 standard deviation = 1 
Formula 
Finding the kth Percentile 


To find the kth percentile when the z-score is known: k = w+ (z)o 
Formula 
z-score 
o—U 
on 
Formula 


Finding the area to the left 


— 


The area to the left: P(X < x) 
Formula 
Finding the area to the right 


The area to the right: P(X > 7) = 1— P(X < 2) 


Practice: The Normal Distribution 


Student Learning Outcomes 


e The student will analyze data following a normal distribution. 


Given 


The life of Sunshine CD players is normally distributed with a mean of 4.1 
years and a standard deviation of 1.3 years. A CD player is guaranteed for 3 
years. We are interested in the length of time a CD player lasts. 


Normal Distribution 
Exercise: 


Problem: Define the Random Variable X in words. X = 


Exercise: 


Problem: X~ 
Exercise: 


Problem: 


Find the probability that a CD player will break down during the 
guarantee period. 


e a Sketch the situation. Label and scale the axes. Shade the region 
corresponding to the probability. 


ebP(0<a< = (Use zero (0) for the 
minimum value of x.) 


Solution: 
¢ b3,0.1979 
Exercise: 
Problem: 
Find the probability that a CD player will last between 2.8 and 6 years. 


e a Sketch the situation. Label and scale the axes. Shade the region 
corresponding to the probability. 


‘bP(._. <a< = 


Solution: 
e b 2.8,6,0.7694 
Exercise: 
Problem: 


Find the 70th percentile of the distribution for the time a CD player 
lasts. 


e a Sketch the situation. Label and scale the axes. Shade the region 
corresponding to the lower 70%. 


___——, Therefore, k = 


© bP(4#<k)= 


Solution: 


¢ b0.70,4.78years 


Normal Distribution Homework Link (Collaborative Statistics; R. Bloom 
custom version) 


Link to homework questions in Homework Collection/Book for Normal 
Distribution Chapter 6 of Collaborative Statistics for R. Bloom 


Chapter 6 Review Questions Link (Collaborative Statistics; R. Bloom 
custom version) 


Link to Review Questions in Homework Collection/Book for Normal 
Distribution Chapter 6 of Collaborative Statistics for R. Bloom 


Chapter 6 Review Questions (_http://cnx.org/content/m19027/latest/_) 


The Central Limit Theorem 
This module provides a brief introduction to the Central Limit Theorem. 


Student Learning Outcomes 
By the end of this chapter, the student should be able to: 


e Recognize the Central Limit Theorem problems. 

¢ Classify continuous word problems by their distributions. 
e Apply and interpret the Central Limit Theorem for Means. 
e Apply and interpret the Central Limit Theorem for Sums. 


Introduction 


Why are we so concerned with means? Two reasons are that they give us a 
middle ground for comparison and they are easy to calculate. In this 
chapter, you will study means and the Central Limit Theorem. 


The Central Limit Theorem (CLT for short) is one of the most powerful 
and useful ideas in all of statistics. Both alternatives are concerned with 
drawing finite samples of size n from a population with a known mean, pL, 
and a known standard deviation, o. The first alternative says that if we 
collect samples of size n and n is "large enough," calculate each sample's 
mean, and create a histogram of those means, then the resulting histogram 
will tend to have an approximate normal bell shape. The second alternative 
says that if we again collect samples of size n that are "large enough," 
calculate the sum of each sample and create a histogram, then the resulting 
histogram will again tend to have a normal bell-shape. 


In either case, it does not matter what the distribution of the original 
population is, or whether you even need to know it. The important fact 
is that the sample means and the sums tend to follow the normal 
distribution. And, the rest you will learn in this chapter. 


The size of the sample, n, that is required in order to be to be ‘large enough’ 
depends on the original population from which the samples are drawn. If 
the original population is far from normal then more observations are 


needed for the sample means or the sample sums to be normal. Sampling is 
done with replacement. 


Optional Collaborative Classroom Activity 


Do the following example in class: Suppose 8 of you roll 1 fair die 10 
times, 7 of you roll 2 fair dice 10 times, 9 of you roll 5 fair dice 10 times, 
and 11 of you roll 10 fair dice 10 times. 


Each time a person rolls more than one die, he/she calculates the sample 
mean of the faces showing. For example, one person might roll 5 fair dice 
and get a 2, 2, 3, 4, 6 on one roll. 


The mean is The 3.4 is one mean when 5 fair dice 


242434446 _ 9 4 
4, 
are rolled. This same person would roll the 5 dice 9 more times and 


calculate 9 more means for a total of 10 means. 


Your instructor will pass out the dice to several people as described above. 
Roll your dice 10 times. For each roll, record the faces and find the mean. 
Round to the nearest 0.5. 


Your instructor (and possibly you) will produce one graph (it might be a 
histogram) for 1 die, one graph for 2 dice, one graph for 5 dice, and one 
graph for 10 dice. Since the "mean" when you roll one die, is just the face 
on the die, what distribution do these means appear to be representing? 


Draw the graph for the means using 2 dice. Do the sample means show 
any kind of pattern? 


Draw the graph for the means using 5 dice. Do you see any pattern 
emerging? 


Finally, draw the graph for the means using 10 dice. Do you see any 
pattern to the graph? What can you conclude as you increase the number of 
dice? 


As the number of dice rolled increases from 1 to 2 to 5 to 10, the following 
is happening: 


1. The mean of the sample means remains approximately the same. 

2. The spread of the sample means (the standard deviation of the sample 
means) gets smaller. 

3. The graph appears steeper and thinner. 


You have just demonstrated the Central Limit Theorem (CLT). 


The Central Limit Theorem tells you that as you increase the number of 
dice, the sample means tend toward a normal distribution (the 
sampling distribution). 


Glossary 


Average 
A number that describes the central tendency of the data. There are a 
number of specialized averages, including the arithmetic mean, 
weighted mean, median, mode, and geometric mean. 


Central Limit Theorem 
Given a random variable (RV) with known mean pu and known 
standard deviation o. We are sampling with size n and we are 
interested in two new RVs - the sample mean, X, and the sample sum, 
3/X. If the size n of the sample is sufficiently large, then X ~ 


N(n, <) and XX ~ N(np, no). If the size n of the sample is 


sufficiently large, then the distribution of the sample means and the 
distribution of the sample sums will approximate a normal distribution 
regardless of the shape of the population. The mean of the sample 
means will equal the population mean and the mean of the sample 
sums will equal n times the population ea The standard deviation 
of the distribution of the sample means, Tn , is called the standard 


error of the mean. 


The Central Limit Theorem for Sample Means (Averages) 


Suppose X is a random variable with a distribution that may be known or 
unknown (it can be any distribution). Using a subscript that matches the 
random variable, suppose: 


° ajx = the mean of X 
e boy = the standard deviation of X 


If you draw random samples of size n, then as n increases, the random 


variable X which consists of sample means, tends to be normally 
distributed and 


X~ N(x, ) 


The Central Limit Theorem for Sample Means says that if you keep 
drawing larger and larger samples (like rolling 1, 2, 5, and, finally, 10 dice) 
and calculating their means the sample means form their own normal 
distribution (the sampling distribution). The normal distribution has the 
Same mean as the original distribution and a variance that equals the 
original variance divided by n, the sample size. n is the number of values 
that are averaged together not the number of times the experiment is done. 


To put it more formally, if you draw random samples of size n,the 
distribution of the random variable X , which consists of sample means, is 
called the sampling distribution of the mean. The sampling distribution of 
the mean approaches a normal distribution as n, the sample size, increases. 


The random variable X has a different z-score associated with it than the 
random variable X. x is the value of X in one sample. 
Equation: 


wv PX 


@ 


— 


tx is both the average of X and of X. 


Oy = a4 = standard deviation of X and is called the standard error of 


the mean. 


Example: 

An unknown distribution has a mean of 90 and a standard deviation of 15. 
Samples of size n = 25 are drawn randomly from the population. 
Exercise: 


Problem: 

Find the probability that the sample mean is between 85 and 92. 
Solution: 

Let X = one value from the original unknown population. The 
probability question asks you to find a probability for the sample 


mean. 


Let X = the mean of a sample of size 25. Since wx = 90, 0x = 15, 
andn = 25; 


. “15 
then X N(90, 45.) 


Find P(85 < x < 92) Draw a graph. 


P(85 < a < 92) = 0.6997 


The probability that the sample mean is between 85 and 92 is 0.6997. 


P(8S < x < 92) 


A | 


85 90 92 


TI-83 or 84: normalcdf (lower value, upper value, mean, standard 
error of the mean) 


The parameter list is abbreviated (lower value, upper value, J, Wad 


normalcdf (85,92,90, = ) = 0.6997 
Exercise: 
Problem: 


Find the value that is 2 standard deviations above the expected value 
(it is 90) of the sample mean. 


Solution: 


To find the value that is 2 standard deviations above the expected 
value 90, use the formula 


value = wx + (#o0fSTDEVs) (+) 


n 


: eee 
value = 90 + 2 FE 96 


So, the value that is 2 standard deviations above the expected value is 
96. 


Example: 

The length of time, in hours, it takes an "over 40" group of people to play 
one soccer match is normally distributed with a mean of 2 hours and a 
standard deviation of 0.5 hours. A sample of size n = 50 is drawn 
randomly from the population. 

Exercise: 


Problem: 


Find the probability that the sample mean is between 1.8 hours and 
2.3 hours. 


Solution: 
Let X = the time, in hours, it takes to play one soccer match. 


The probability question asks you to find a probability for the sample 
mean time, in hours, it takes to play one soccer match. 


Let X = the mean time, in hours, it takes to play one soccer match. 


oie os a Sandi? — , then 
X ~N( ; ) by the Central Limit Theorem for Means. 


ix —2,0,% — 0.5, 77 — 50, and X-N(2, 45) 
Findbe eS 253), Draw a graph. 
GL 2a 2 AS) SO 


pee eee 
normalcdf(1.8,2.3,2, a5) — 0.9977 


The probability that the mean time is between 1.8 hours and 2.3 hours 
is 


Glossary 


Average 
A number that describes the central tendency of the data. There are a 
number of specialized averages, including the arithmetic mean, 
weighted mean, median, mode, and geometric mean. 


Central Limit Theorem 
Given a random variable (RV) with known mean pu and known 
standard deviation o. We are sampling with size n and we are 
interested in two new RVs - the sample mean, X, and the sample sum, 
3/X. If the size n of the sample is sufficiently large, then X ~ 


N(n, <) and XX ~ N (au, Jno). If the size n of the sample is 


sufficiently large, then the distribution of the sample means and the 
distribution of the sample sums will approximate a normal distribution 
regardless of the shape of the population. The mean of the sample 
means will equal the population mean and the mean of the sample 
sums will equal n times the population mean. The standard deviation 
of the distribution of the sample means, Ta is called the standard 


error of the mean. 


Normal Distribution 
A continuous random variable (RV) with pdf 


Ex) = rs e~(*-H)"/20° | where jy. is the mean of the distribution and 


o is the standard deviation. Notation: X ~ N(y,o). If uw = 0 and 
ao = 1, the RV is called the standard normal distribution. 


Standard Error of the Mean 


The standard deviation of the distribution of the sample means, — 


ane 


The Central Limit Theorem for Sums (Optional) 


Suppose X is a random variable with a distribution that may be known or 
unknown (it can be any distribution) and suppose: 


° ax =the mean of X 
e boy = the standard deviation of X 


If you draw random samples of size n, then as n increases, the random 
variable 4X which consists of sums tends to be normally distributed and 


UX ~ N(n- px,./n- ox) 


The Central Limit Theorem for Sums says that if you keep drawing 
larger and larger samples and taking their sums, the sums form their own 
normal distribution (the sampling distribution) which approaches a normal 
distribution as the sample size increases. The normal distribution has a 
mean equal to the original mean multiplied by the sample size and a 
standard deviation equal to the original standard deviation multiplied 
by the square root of the sample size. 


The random variable _X has the following z-score associated with it: 


e a» x is one sum. 
e bz = 22amex 
J/n-ox 


° an- wx = the mean of © X 
e b./n- ox = standard deviation of X 


Example: 

An unknown distribution has a mean of 90 and a standard deviation of 15. 
A sample of size 80 is drawn randomly from the population. 

Exercise: 


Problem: 


¢ aFind the probability that the sum of the 80 values (or the total of 
the 80 values) is more than 7500. 
e bFind the sum that is 1.5 standard deviations above the mean of 
the sums. 
Solution: 
Let X = one value from the original unknown population. The 
probability question asks you to find a probability for the sum (or 


total of) 80 values. 


“X = the sum or total of 80 values. Since wx = 90, 7x = 15, and 
n = 80, then 


ee N(80 - 90, 80 - 15) 


e mean of the sums = n- 4x = (80)(90) = 7200 
e standard deviation of the sums = \/n- ox = V80- 15 
e sum of 80 values = x = 7500 


e aFind P(=x > 7500) 


JE( Dee 7151010) UA 


P > % > 7500 


yx 


7200 7500 


normalcdf (lower value, upper value, mean of sums, stdev of 
sums) 


The parameter list is abbreviated (lower, upper, n - x, \/n- ox) 


normalcdf(7500,1E99, 80 - 90, 80 - 15) = 0.0127 
Reminder: 1E99 = 10°°. Press the EE key for E. 


e bFind ix where z = 1.5: 
Ux=n-px t+ z-./n-ox = (80)(90) + (1.5)(V/80) (15) = 7401.2 


Glossary 


Central Limit Theorem 
Given a random variable (RV) with known mean p and known 
standard deviation o. We are sampling with size n and we are 
interested in two new RVs - the sample mean, X, and the sample sum, 
3/X. If the size n of the sample is sufficiently large, then X ~ 


N(n, a and 3X ~ N (nu, Jno). If the size n of the sample is 


sufficiently large, then the distribution of the sample means and the 
distribution of the sample sums will approximate a normal distribution 
regardless of the shape of the population. The mean of the sample 
means will equal the population mean and the mean of the sample 
sums will equal n times the population mean. The standard deviation 


of the distribution of the sample means, —~, is called the standard 


Jn ’ 


error of the mean. 


Normal Distribution 


A continuous random variable (RV) with pdf 


f(x) = TE e~(=—-H)"/20° where js is the mean of the distribution and 


o is the standard deviation. Notation: X ~ N(w,o). If u = 0 and 
ao = 1, the RV is called the standard normal distribution. 


Central Limit Theorem: Using the C.L.T. (modified R. Bloom) 


It is important to understand when to use the CLT. Use the CLT for means 
or averages when you are asked to find the probability for a sample average 
or mean, or when working with percentiles for sample averages. (If you are 
being asked to find the probability or percentile of a sum or total, use the 
CLT for sums.) 


Note:If you are being asked to find the probability of an individual value, 
do not use the CLT. Use the distribution of its random variable. 


Law of Large Numbers 


The Law of Large Numbers says that if you take samples of larger and 
larger size from any population, then the mean z of the sample gets closer 
and closer to jz. From the Central Limit Theorem, we know that as n gets 
larger and larger, the sample averages follow a normal distribution. The 
larger n gets, the smaller the standard deviation gets. (Remember that the 


standard deviation for X is Va .) This means that the sample mean x must 


be close to the population mean jz. We can say that py is the value that the 
sample averages approach as n gets larger. The Central Limit Theorem 
illustrates the Law of Large Numbers. 


Example: 

A study involving stress is done on a college campus among the students. 
The stress scores follow a continuous uniform distribution with the 
lowest stress score equal to 1 and the highest equal to 5. Using a sample of 
75 students, find: 


e aThe probability that the average stress score for the 75 students is 
less than 2. 
e bThe 90th percentile for the average stress score for the 75 students. 


Let X = the stress score for one individual student 
The individual stress scores follow a continuous uniform distribution, X ~ 
U(1, 5) where a = 1 and b = 5 (See the chapter on Continuous Random 


eee 


ig 
Ox = tar (Gar eu = a5 


Problems a a b ask you to find a probability or a percentile for an 
average or mean. The sample size, n, is equal to 75. 

Let X = the average stress score for the 75 students. 

For the average stress score, use the CLT which tells us that X ~ 


N(n, Vn 

Her N(3, 118 | where n = 75. 

Exercise: 
Problem: Find P(x A) Draw the graph. 
Solution: 
P(X eat 


The probability that the average stress score is less than 2 is about 0. 


p(x < 2) 


normalcdf (1, 2a is.) = = 0 


Note:The smallest stress score is 1. Therefore, the smallest average 
for 75 stress scores is 1. 


Exercise: 


Problem: 


Find the 90th percentile for the sample average of 75 stress scores. 
Draw a graph. 


Solution: 


Let k = the 90th precentile. Find k where P(X < k) = 0.90. 


k = 3.17 using invNorm ( 90,3, +42 ) Sly 


P(x < k)= 0.90 


a 


The 90th percentile for the sample average of 75 scores is about 3.17. 
This means that 90% of all the averages of samples of 75 stress scores 
are at most 3.17 and 10% of the sample averages are at least 3.17. 


Example: 

Suppose that a market research analyst for a cell phone company conducts 
a study of their customers who exceed the time allowance included on their 
basic cell phone contract; the analyst finds that for those people who 
exceed the time included in their basic contract, the excess time used 
follows an exponential distribution with a mean of 22 minutes. 

Consider a random sample of 80 customers who exceed the time allowance 
included in their basic cell phone contract. 

Let X = the excess time used by one INDIVIDUAL cell phone customer 
who exceeds his contracted time allowance. 

DG Exp(z;) From Chapter 5, we know that 2 = 22 ando = 22. 

Let X = the AVERAGE excess time used by a sample of n = 80 
customers who exceed their contracted time allowance. 


X~N (22, 22. by the CLT for Sample Means or Averages 
Exercise: 

Problem: 

Using the CLT to find Probability: 


e aFind the probability that the average excess time used by the 80 
customers in the sample is longer than 20 minutes. This is asking 


us to find P (x > 20) Draw the graph. 


e b Suppose that one customer who exceeds the time limit for his 
cell phone contract is randomly selected. Find the probability 
that this individual customer's excess time is longer than 20 
minutes. This is asking us to find P(X > 20) 

e c Explain why the probabilities in (a) and (b) are different. 


Solution: 
Part a. 


Find: P(X > 20) 


P(X > 20) = 0.7919 using normalcdf (20, 1E99, 22, | 


The probability is 0.7919 that the average excess time used is more 
than 20 minutes, for a sample of 80 customers who exceed their 
contracted time allowance. 


p(x > 20) 


20 22 


Note:1E99 = 10°%and-1E99 — —10°. Press the 
EE 


key for E. Or just use 10499 instead of 1E99. 


Part b. 
Find P(X>20) . Remember to use the exponential distribution for an 
individual: X~Exp(1/22). 


P(X>20) = e\(-(1/22)*20) or e\(—.04545*20) = 0.4029 
Part c. Explain why the probabilities in (a) and (b) are different. 


¢ P(X > 20) = 0.4029 but P(X > 20) = 0.7919 


e The probabilities are not equal because we use different 
distributions to calculate the probability for individuals and for 
averages. 

e When asked to find the probability of an individual value, use the 
stated distribution of its random variable; do not use the CLT. 
Use the CLT with the normal distribution when you are being 
asked to find the probability for an average. 


Exercise: 
Problem: 


Using the CLT to find Percentiles: 

Find the 95th percentile for the sample average excess time for 
samples of 80 customers who exceed their basic contract time 
allowances. Draw a graph. 


Solution: 


Let k = the 95th percentile. Find k where P(X ck) 05 


_ af 2) _ 
k = 26.0 using invNorm(.95, 22, 22.) — 26.0 


P(x <k)= 0.95 


x 
k 


The 95th percentile for the sample average excess time used is about 
26.0 minutes for random samples of 80 customers who exceed their 
contractual allowed time. 


95% of such samples would have averages under 26 minutes; only 5% 
of such samples would have averages above 26 minutes. 


Glossary 


Average 
A number that describes the central tendency of the data. There are a 
number of specialized averages, including the arithmetic mean, 
weighted mean, median, mode, and geometric mean. 


Central Limit Theorem 
Given a random variable (RV) with known mean pu and known 
variance o ”, we are sampling with size n and we are interested in two 
new RV - sample mean, X,and sample sum,» X. If the size n of the 


sample is sufficiently large, then X~ N (nu, é) and 7X ~ 


N (ny, n, a”). In words, if the size n of the sample is sufficiently 


large, then the distribution of the sample means and the distribution of 
the sample sums will approximate a normal distribution regardless of 


the shape of the population. And even more, the mean of the sampling 
distribution will equal the population mean and mean of sampling 
sums will equal n times the population mean. The standard deviation 


of the distribution of the sample means, —~, is called standard error of 


eet? 


the mean. 


Exponential Distribution 
Continuous random variable (RV) that appears when we are interested 
in intervals of time between some random events, for example, the 
length of time between emergency arrivals at a hospital. Notation: 
X~-Exp(m); the mean is . = =, and the variance is 7” = —,., the 
probability density function is f(z) = me ™*, x > Oand cumulative 
distribution is P(X <a) =1—e™*. 


ny 


Mean 
A number to measure the central tendency (average), shortening from 
arithmetic mean. By definition, the mean for a sample (usually denoted 


v\:. y _. Sumof all values in the sample 
by X) is X = Number of values in the sample ” and the mean for a 


population (usually denoted by m) is 
Sum of all values in the population 


™ = Number of values in the population ° 


Summary of Formulas 
Formula 
Central Limit Theorem for Sample Means 


X~N(ux, ) The Mean (x): [Lx 
Formula 


Central Limit Theorem for Sample Means Z-Score and Standard Error of 
the Mean 


z= (& ) Standard Error of the Mean (Standard Deviation 
Vn 
(x): 


Formula 
Central Limit Theorem for Sums 


uX~ N|(n)-ux,/n-ox| Mean for Sums (DX): n- ux 
Formula 
Central Limit Theorem for Sums Z-Score and Standard Deviation for Sums 


Ux—n- px 


VMox 


= Standard Deviation for Sums (»X): J/n-ox 


Practice: Central Limit Theorem (modified R. Bloom) 

This module contains practice problems for the Central Limit Theorem 
from Collaborative Statistics by Susan Dean and Dr. Barbara Illowsky. The 
problems relating to Central Limit Theorem for averages have not been 
changed in this module. The problems relating to Central Limit Theorem 
for sums have been removed from this module. 


Student Learning Outcomes 


e The student will explore the properties of data through the Central 
Limit Theorem. 


Given 


Yoonie is a personnel manager in a large corporation. Each month she must 
review 16 of the employees. From past experience, she has found that the 
reviews take her approximately 4 hours each to do with a population 
standard deviation of 1.2 hours. Let X be the random variable representing 
the time it takes her to complete one review. Assume X is normally 
distributed. Let _X be the random variable representing the average time to 
complete the 16 reviews. Let 4X be the total time it takes Yoonie to 
complete all of the month’s reviews. 


Distribution 


Complete the distributions. 


he, Ga 
ae, Gea 


Graphing Probability 
For each problem below: 


e a Sketch the graph. Label and scale the horizontal axis. Shade the 
region corresponding to the probability. 


e b Calculate the value. 


Exercise: 


Problem: 


Find the probability that one review will take Yoonie from 3.5 to 4.25 
hours. 


ea 


. of a 


Solution: 
e b3.5, 4.25, 0.2441 
Exercise: 
Problem: 


Find the probability that the average of a month’s reviews will take 
Yoonie from 3.5 to 4.25 hrs. 


ea 


asl 


*bP()= 


Solution: 


e¢ b 0.7499 

¢ NOTE:When calculating the standard deviation for the mean 
using the Central Limit Theorem in this problem, the sample size 
is n = 16, the number of reviews she completes in a month. 


Exercise: 
Problem: 


Find the 95th percentile for the average time to complete one month’s 
reviews. 


ea 


al 


e bThe 95th Percentile= 


Solution: 


e b 4.49 hours 


Discussion Question 


Exercise: 


Problem: What causes the probabilities in [link] and [link] to differ? 


Central Limit Theorem Homework Link 


Link to homework questions in Homework Collection/Book for Central 
Limit Theorem Chapter 7 of Collaborative Statistics for R. Bloom 


Chapter 7 Review Questions Link (Collaborative Statistics; R. Bloom 
custom version) 


Link to Review Questions in Homework Collection/Book for Central Limit 
Theorem Chapter 7 of Collaborative Statistics for R. Bloom 


Confidence Intervals 


Student Learning Outcomes 
By the end of this chapter, the student should be able to: 


¢ Calculate and interpret confidence intervals for one population mean 
and one population proportion. 

e Interpret the student-t probability distribution as the sample size 
changes. 

e Discriminate between problems applying the normal and the student-t 
distributions. 


Introduction 


Suppose you are trying to determine the mean rent of a two-bedroom 
apartment in your town. You might look in the classified section of the 
newspaper, write down several rents listed, and average them together. You 
would have obtained a point estimate of the true mean. If you are trying to 
determine the percent of times you make a basket when shooting a 
basketball, you might count the number of shots you make and divide that 
by the number of shots you attempted. In this case, you would have 
obtained a point estimate for the true proportion. 


We use sample data to make generalizations about an unknown population. 
This part of statistics is called inferential statistics. The sample data help 
us to make an estimate of a population parameter. We realize that the 
point estimate is most likely not the exact value of the population 
parameter, but close to it. After calculating point estimates, we construct 
confidence intervals in which we believe the parameter lies. 


In this chapter, you will learn to construct and interpret confidence 
intervals. You will also learn a new distribution, the Student's-t, and how it 
is used with these intervals. Throughout the chapter, it is important to keep 
in mind that the confidence interval is a random variable. It is the parameter 
that is fixed. 


If you worked in the marketing department of an entertainment company, 
you might be interested in the mean number of compact discs (CD's) a 
consumer buys per month. If so, you could conduct a survey and calculate 
the sample mean, z, and the sample standard deviation, s. You would use x 
to estimate the population mean and s to estimate the population standard 
deviation. The sample mean, 2, is the point estimate for the population 
mean, p. The sample standard deviation, s, is the point estimate for the 
population standard deviation, o. 


Each of x and s is also called a statistic. 


A confidence interval is another type of estimate but, instead of being just 
one number, it is an interval of numbers. The interval of numbers is a range 
of values calculated from a given set of sample data. The confidence 
interval is likely to include an unknown population parameter. 


Suppose for the CD example we do not know the population mean p but we 
do know that the population standard deviation is o = 1 and our sample 
size is 100. Then by the Central Limit Theorem, the standard deviation for 
the sample mean is 


Co 1 
Vn —_ “V100 — 0.1. 
The Empirical Rule, which applies to bell-shaped distributions, says that in 
approximately 95% of the samples, the sample mean, 2, will be within two 
standard deviations of the population mean jz. For our CD example, two 
standard deviations is (2)(0.1) = 0.2. The sample mean z is likely to be 
within 0.2 units of pu. 


Because z is within 0.2 units of 44, which is unknown, then yp is likely to be 
within 0.2 units of z in 95% of the samples. The population mean pu is 
contained in an interval whose lower number is calculated by taking the 
sample mean and subtracting two standard deviations ((2)(0.1)) and whose 
upper number is calculated by taking the sample mean and adding two 
standard deviations. In other words, pz is between x — 0.2 and x + 0.2 in 
95% of all the samples. 


For the CD example, suppose that a sample produced a sample mean x = 2 
. Then the unknown population mean yp is between 


£=0.23=2=02 = 13 anda+ 0.2 = 2+ 0.2 = 72.2 


We say that we are 95% confident that the unknown population mean 
number of CDs is between 1.8 and 2.2. The 95% confidence interval is 
(1.8, 2.2). 


The 95% confidence interval implies two possibilities. Either the interval 
(1.8, 2.2) contains the true mean yp or our sample produced an z that is not 
within 0.2 units of the true mean pw. The second possibility happens for only 
5% of all the samples (100% - 95%). 


Remember that a confidence interval is created for an unknown population 
parameter like the population mean, jz. Confidence intervals for some 
parameters have the form 


(point estimate - margin of error, point estimate + margin of error) 


The margin of error depends on the confidence level or percentage of 
confidence. 


When you read newspapers and journals, some reports will use the phrase 
"margin of error." Other reports will not use that phrase, but include a 
confidence interval as the point estimate + or - the margin of error. These 
are two ways of expressing the same concept. 


Note: Although the text only covers symmetric confidence intervals, there 
are non-symmetric confidence intervals (for example, a confidence interval 
for the standard deviation). 


Optional Collaborative Classroom Activity 


Have your instructor record the number of meals each student in your class 
eats out in a week. Assume that the standard deviation is known to be 3 
meals. Construct an approximate 95% confidence interval for the true mean 
number of meals students eat out each week. 


1. Calculate the sample mean. 
2.0 = 3 and n = the number of students surveyed. 


3. Construct the interval «2 —2-—4,x%+4+2.- 


Vn? 


_F_ 


J/n 


We say we are approximately 95% confident that the true average number 
of meals that students eat out in a week is between and 


Glossary 


Confidence Interval (CI) 
An interval estimate for an unknown population parameter. This 
depends on: 


e The desired confidence level. 

e Information that is known about the distribution (for example, 
known standard deviation). 

e The sample and its size. 


Inferential Statistics 
Also called statistical inference or inductive statistics. This facet of 
Statistics deals with estimating a population parameter based on a 
sample statistic. For example, if 4 out of the 100 calculators sampled 
are defective we might infer that 4 percent of the production is 
defective. 


Parameter 
A numerical characteristic of the population. 


Point Estimate 
A single number computed from a sample and used to estimate a 
population parameter. 


Confidence Intervals for a Population Mean, Population Standard Deviation 
Known, Normal (modified R. Bloom) 

This module explains how to construct a confidence interval estimate for an 
unknown population mean when the population standard deviation is 
known, using the Standard Normal distribution. This module has been 
revised from the original module m16962 written by authors S. Dean and 
Dr. B. Illowsky in the textbook collection Collaborative Statistics. Most of 
the content is identical to the original module; it has been revised to include 
step by step solutions for all examples. In addition, this revision of the 
module now includes the calculation of the sample size needed to obtain a 
specified margin of error and confidence level. 


Calculating the Confidence Interval 


To construct a confidence interval for a single unknown population mean pu 
, where the population standard deviation is known, we need z as an 
estimate for jz and we need the margin of error. Here, the margin of error is 
called the error bound for a population mean (abbreviated EBM). The 
sample mean z is the point estimate of the unknown population mean ps 
The confidence interval estimate will have the form: 


e (point estimate - error bound, point estimate + error bound) or, in 
symbols,(z — EBM, z + EBM) 


The margin of error depends on the confidence level (abbreviated CL). The 
confidence level is the probability that the confidence interval estimate that 
we will calculate will contain the true population parameter. Most often, it 
is the choice of the person constructing the confidence interval to choose a 
confidence level of 90% or higher because he wants to be reasonably 
certain of his conclusions. 


There is another probability called alpha (@). @ is related to the confidence 
level CL. @ is the probability that the sample produced a point estimate that 
is not within the appropriate margin of error of the unknown population 
parameter. 


Example: 


e Suppose we have collected data from a sample. We know the sample 
average but we do not know the average for the entire population. 
e The sample mean is 7 and the error bound for the mean is 2.5. 


oo 7 anc Nie: 

The confidence interval is (7 — 2.5, 7 + 2.5); calculating the values gives 
(4.5, 9.5). 

If the confidence level (CL) is 95%, then we say that "We estimate with 
95% confidence that the true value of the population mean is between 4.5 
and 9.5." 


A confidence interval for a population mean with a known standard 
deviation is based on the fact that the sample means follow an 
approximately normal distribution. Suppose that our sample has a mean of 
x = 10 and we have constructed the 90% confidence interval (5, 15) where 
EBM = 5. 


To get a 90% confidence interval, we must include the central 90% of the 
probability of the normal distribution. If we include the central 90%, we 
leave out a total of 10% in both tails, or 5% in each tail, of the normal 
distribution. 


Confidence Level (CL) = 0.90 


x= 10 
EBM = 5 
= x-EBM = 5 


\ 53 
5 15 x+EBM = 15 


Lt is believed to be in the interval (5, 15) with 90% confidence. 


To capture the central 90%, we must go out 1.645 "standard deviations" on 
either side of the calculated sample mean. 1.645 is the z-score from a 
Standard Normal probability distribution that puts an area of 0.90 in the 
center, an area of 0.05 in the far left tail, and an area of 0.05 in the far right 
tail. 


It is important that the "standard deviation" used must be appropriate for the 
parameter we are estimating. So in this section, we need to use the standard 
deviation that applies to sample means, which is Wa Te is commonly 

called the "standard error of the mean" in order to clearly distinguish the 
standard deviation for a mean from the population standard deviation o. 


In summary, as a result of the Central Limit Theorem: 


e X is normally distributed, that is, X ~ N (u oe ) 


e When the population standard deviation o is known, we use a 
Normal distribution to calculate the error bound. 


Calculating the Confidence Interval: 

To construct a confidence interval estimate for an unknown population 
mean, we need data from a random sample. The steps to construct and 
interpret the confidence interval are: 


¢ Calculate the sample mean X from the sample data. Remember, in this 
section, we already know the population standard deviation o. 

e Find the Z-score that corresponds to the confidence level. 

e Calculate the error bound EBM 

e Construct the confidence interval 

e Write a sentence that interprets the estimate in the context of the 
situation in the problem. (Explain what the confidence interval means, 
in the words of the problem.) 


We will first examine each step in more detail, and then illustrate the 
process with some examples. 


Finding Z for the stated Confidence Level 
When we know the population standard deviation o, we use a standard 
normal! distribution to calculate the error bound EBM and construct the 


confidence interval. We need to find the value of Z that puts an area equal 
to the confidence level (in decimal form) in the middle of the standard 
normal distribution Z~N(0,1). 


The confidence level, CL, is he area in the middle of the standard normal 
distribution. CL = 1 — a. So a is the area that is split equally between the 
two tails. Each of the tails contains an area equal to + . 


The z-score that has an area to the right of 5 is denoted by z« 


For example, when CL = 0.95 then a = 0.05 and > = 0.025 ; we write 
Za = 2025 


The area to the right of 2.995 is 0.025 and the area to the left of z.o95 is 1- 
0.025 = 0.975 


Za = 29.925 = 1.96, using a calculator, computer or a Standard Normal 
probability table. 


Using the TI83, TI83+ or TI84+ calculator: invNorm(.975, 0,1) = 1.96 


CALCULATOR NOTE: Remember to use area to the LEFT of ze ;in this 


chapter the last two inputs in the invnorm command are 0,1 because you are 
using a Standard Normal Distribution Z~N(0,1) 


EBM: Error Bound 
The error bound formula for an unknown population mean pz when the 
population standard deviation o is known is 


° EBM = zg -—— 


Constructing the Confidence Interval 


e The confidence interval estimate has the format 
(2 — EBM,z + EBM). 


The graph gives a picture of the entire situation. 


Ch-F > 5 =Ch--a= 1. 


o. a 
2 CL=l-a 9 


~< | 


x - EBM x +EBM 


Writing the Interpretation 

The interpretation should clearly state the confidence level (CL), explain 
what population parameter is being estimated (here, a population mean or 
average ), and should state the confidence interval (both endpoints). "We 
estimate with ___% confidence that the true population average (include 
context of the problem) is between ____ and ____ (include appopriate units)." 


Example: 

Suppose scores on exams in statistics are normally distributed with an 
unknown population mean and a population standard deviation of 3 points. 
A random sample of 36 scores is taken and gives a sample mean (sample 
average score) of 68. Find a confidence interval estimate for the population 
mean exam score (the average score on all exams). 

Exercise: 


Problem: 


Find a 90% confidence interval for the true (population) mean of 
Statistics exam scores. 


e The solution is shown step-by-step. 


Solution: 


To find the confidence interval, you need the sample mean, x, and the 
EBM. 


¢ ¢ = 3;n = 36; The confidence level is 90% (CL=0.90) 
CL = 0.90 soa = 1—CL=1— 0.90 = 0.10 
a = KOS Be Ae 


The area to the right of 2.95 is 0.05 and the area to the left of z.95 is 
1-0.05=0.95 


using invnorm(.95,0,1) on the TI-83,83+,84+ calculators. This can 
also be found using appropriate commands on other calculators, using 
a computer, or using a probability table for the Standard Normal 
distribution. 


_ Sane Nick 
EBM = 1.645 ( | 0.8225 


2B 68 — 058225 — 01 itr 
x + EBM = 68 + 0.8225 = 68.8225 


The 90% confidence interval is (67.1775, 68.8225). 


Interpretation 

We estimate with 90% confidence that the true population mean exam 
score for all statistics students is between 67.18 and 68.82. 

Explanation of 90% Confidence Level 

90% of all confidence intervals constructed in this way contain the true 
average Statistics exam score. For example, if we constructed 100 of these 


confidence intervals, we would expect 90 of them to contain the true 
population mean exam score. 


Changing the Confidence Level or Sample Size 


Example: 
Changing the Confidence Level 
Exercise: 


Problem: 


Suppose we change the original problem by using a 95% confidence 
level. Find a 95% confidence interval for the true (population) mean 
Statistics exam score. 


Solution: 


To find the confidence interval, you need the sample mean, z, and the 
EBM. 


e + — 68 


- EBM = zz - () 


¢ ¢ = 3;n = 36; The confidence level is 95% (CL=0.95) 
CL = 0.95 soa =1—CL=1—0.95 = 0.05 
= = 0.025 ze = 2.025 


The area to the right of 2.925 is 0.025 and the area to the left of z.995 is 
1-0.025=0.975 


ae Z.025 — 1.96 


using invnorm(.975,0,1) on the TI-83,83+,84+ calculators. (This can 
also be found using appropriate commands on other calculators, using 
a computer, or using a probability table for the Standard Normal 
distribution. ) 


me ene vee 
EBM = 1.96 (+5) 0.98 


op — 65 0938 — 07.02 


2, LBM — 68> 0:98 — 63.98 


Interpretation 
We estimate with 95 % confidence that the true population average for all 
Statistics exam scores is between 67.02 and 68.98. 

Explanation of 95% Confidence Level 

95% of all confidence intervals constructed in this way contain the true 
value of the population average statistics exam score. 

Comparing the results 

The 90% confidence interval is (67.18, 68.82). The 95% confidence 
interval is (67.02, 68.98). The 95% confidence interval is wider. If you 
look at the graphs, because the area 0.95 is larger than the area 0.90, it 
makes sense that the 95% confidence interval is wider. 


0.025 


0.05 0.90 0.05 0.025 0.95 
WAL : \LAL : 


Summary: Effect of Changing the Confidence Level 


e Increasing the confidence level increases the error bound, making the 


confidence interval wider. 
e Decreasing the confidence level decreases the error bound, making 
the confidence interval narrower. 


Example: 

Changing the Sample Size: 

Suppose we change the original problem to see what happens to the error 
bound if the sample size is changed. 

Exercise: 


Problem: 
Leave everything the same except the sample size. Use the original 
90% confidence level. What happens to the error bound and the 
confidence interval if we increase the sample size and use n=100 
instead of n=36? What happens if we decrease the sample size to 
n=25 instead of n=36? 

“008 

+ EBM = zz -(-4) 

¢ o = 3; The confidence level is 90% (CL=0.90) ; 

Be 1.645 


Solution: 


If we increase the sample size n to 100, we decrease the error bound. 


a : ERAT (esis Wee iy ee ee 
When n = 100: EBM = zg - (-%) = 1.645 - (2) = 0.4935 


Solution: 


If we decrease the sample size n to 25, we increase the error bound. 


ne ; SAA (REL eee hy Meee ses 
When n = 25: EBM = zz - (~~) = 1.645- (4) = 0.987 
Summary: Effect of Changing the Sample Size 


e Increasing the sample size causes the error bound to decrease, making 
the confidence interval narrower. 


e Decreasing the sample size causes the error bound to increase, making 
the confidence interval wider. 


Working Backwards to Find the Error Bound or Sample Mean 


Working Backwards to find the Error Bound or the Sample Mean 
When we calculate a confidence interval, we find the sample mean and 
calculate the error bound and use them to calculate the confidence interval. 
But sometimes when we read statistical studies, the study may state the 
confidence interval only. If we know the confidence interval, we can work 
backwards to find both the error bound and the sample mean. 

Finding the Error Bound 


e From the upper value for the interval, subtract the sample mean 
e OR, From the upper value for the interval, subtract the lower value. 
Then divide the difference by 2. 


Finding the Sample Mean 


e Subtract the error bound from the upper value of the confidence 
interval 
e OR, Average the upper and lower endpoints of the confidence interval 


Notice that there are two methods to perform each calculation. You can 
choose the method that is easier to use with the information you know. 


Example: 

Suppose we know that a confidence interval is (67.18, 68.82) and we want 
to find the error bound. We may know that the sample mean is 68. Or 
perhaps our source only gave the confidence interval and did not tell us the 
value of the the sample mean. 

Calculate the Error Bound: 


e If we know that the sample mean is 68: EBM = 68.82 — 68 = 0.82 


e If we don't know the sample mean: EBM = zat 82 


Calculate the Sample Mean: 


e If we know the error bound: x = 68.82 — 0.82 = 68 


(67.18+68.82) 
2 


e If we don't know the error bound: z = — 68 


Calculating the Sample Size n 


If researchers desire a specific margin of error, then they can use the error 
bound formula to calculate the required sample size. 


The error bound formula for a population mean when the population 


standard deviation is known is EBM = ze - ( 
The formula for sample size isn = a , found by solving the error 


bound formula for n 


In this formula, z is z2, corresponding to the desired confidence level. A 


researcher planning a study who wants a specified confidence level and 
error bound can use this formula to calculate the size of the sample needed 
for the study. 


Example: 

The population standard deviation for the age of Foothill College students 
is 15 years. If we want to be 95% confident that the sample mean age is 
within 2 years of the true population mean age of Foothill College students 
, how many randomly selected Foothill College students must be 
surveyed? 


e From the problem, we know that 0 = 15 and EBM=2 


° Z= 2025 = 1.96, because the confidence level is 95%. 


D2: 2, 2 
wo = 13g =216.09 using the sample size equation. 


e Use n = 217: Always round the answer UP to the next higher integer 
to ensure that the sample size is large enough. 


Therefore, 217 Foothill College students should be surveyed in order to be 
95% confident that we are within 2 years of the true population age of 
Foothill College students. 


Glossary 


Confidence Interval 
An interval estimate for unknown population parameter. This depends 
on: 


¢ The desired confidence level. 

e What is known for the distribution information (for ex., known 
variance). 

¢ Gathering from the sampling information. 


Confidence Level 
The percent expression for the probability that the confidence interval 
contains the true population parameter. That is, for ex., if CL=90%, 
then in 90 out of 100 samples the interval estimate will enclose the true 
population parameter. 


Error Bound for a Population Mean (EBM) 
The margin of error. Depends on the confidence level, sample size, and 
known or estimated population standard deviation. 


Normal Distribution 


’ 


A continuous random variable (RV) with pdf = Te e~ (en)? /20° 


where py is the mean of the distribution and a is its standard deviation. 


Notation: X ~ N(u, a) If uw = 0 ando = 1, the RV is called 
standard normal distribution, or z-score. 


Confidence Interval for a Population Mean, Standard Deviation Unknown, 
Student-T (modifed R. Bloom) 

This module explains how to construct a confidence interval estimate for an 
unknown population mean when the population standard deviation is 
unknown, using the Student-t distribution. This module has been revised 
from the original module m16959 by S. Dean and Dr. B. Illowsky in the 
textbook collection Collaborative Statistics to include step by step solutions 
for all examples. 


In practice, we rarely know the population standard deviation. In the past, 
when the sample size was large, this did not present a problem to 
Statisticians. They used the sample standard deviation s as an estimate for 7 
and proceeded as before to calculate a confidence interval with close 
enough results. However, statisticians ran into problems when the sample 
size was small. A small sample size caused inaccuracies in the confidence 
interval. 


William S. Gossett (1876-1937) of the Guinness brewery in Dublin, Ireland 
ran into this problem. His experiments with hops and barley produced very 
few samples. Just replacing o with s did not produce accurate results when 
he tried to calculate a confidence interval. He realized that he could not use 
a normal distribution for the calculation; he found that the actual 
distribution depends on the sample size. This problem led him to "discover" 
what is called the Student-t distribution. The name comes from the fact 
that Gosset wrote under the pen name "Student." 


Up until the mid 1990s, statisticians used the normal distribution 
approximation for large sample sizes and only used the Student-t 
distribution for sample sizes of at most 30. With the common use of 
graphing calculators and computers, the practice is to use the Student-t 
distribution whenever s is used as an estimate for o. 


If you draw a simple random sample of size n from a population that has 
approximately a normal distribution with mean pw and unknown population 
standard deviation o and calculate the t-score t = G) 
Vn 
follow a Student-t distribution with n — 1 degrees of freedom. The t- 
score has the same interpretation as the z-score. It measures how far Z is 


, then the t-scores 


from its mean jz. For each sample size n, there is a different Student-t 
distribution. 


The degrees of freedom, m — 1, come from the calculation of the sample 
standard deviation s. In Chapter 2, we used n deviations (x — Z values) to 
calculate s. Because the sum of the deviations is 0, we can find the last 
deviation once we know the other n — 1 deviations. The other n — 1 
deviations can change or vary freely. We call the number n — 1 the 
degrees of freedom (df). 

Properties of the Student-t Distribution 


¢ The graph for the Student-t distribution is similar to the Standard 
Normal curve. 

e The mean for the Student-t distribution is 0 and the distribution is 
symmetric about 0. 

e The Student-t distribution has more probability in its tails than the 
Standard Normal distribution because the spread of the t distribution is 
greater than the spread of the Standard Normal. So the graph of the 
Student-t distribution will be thicker in the tails and shorter in the 
center than the graph of the Standard Normal distribution. 

e The exact shape of the Student-t distribution depends on the "degrees 
of freedom". As the degrees of freedom increases, the graph Student-t 
distribution becomes more like the graph of the Standard Normal 
distribution. 

e The underlying population of individual observations is assumed to be 
normally distributed with unknown population mean ps and unknown 
population standard deviation o. In the real world, however, as long as 
the underlying population is large and bell-shaped, and the data are a 
simple random sample, practitioners often consider the assumptions 
met. 


Calculators and computers can easily calculate any Student-t probabilities. 
The TI-83,83+,84+ have a tcdf function to find the probability for given 
values of t. The grammar for the tcdf command is tcdf(lower bound, upper 
bound, degrees of freedom). However for confidence intervals, we need to 
use inverse probability to find the value of t when we know the probability. 


For the TI-84+ we will use the invT command on the DISTRibution menu. 
The invT command works similarly to the invnorm. The invT command 
requires two inputs: invT(area to the left, degrees of freedom) The output 
is the t-score that corresponds to the area we specified. 


The TI-83 and TI-83+ do not have the invT command but you can 
download an invT program from your instructor that is easy to use. (The TI- 
89 has an inverse T command.) 


A probability table for the Student-t distribution can also be used. The table 
gives t-scores that correspond to the confidence level (column) and degrees 
of freedom (row). (The TI-86 does not have an invT program or command, 
so if you are using that calculator, you need to use a probability table for the 
Student-t distribution.) When using t-table, note that some tables are 
formatted to show the confidence level in the column headings, while the 
column headings in some tables may show only corresponding area in one 
or both tails. 

The notation for the Student-t distribution is (using T as the random 
variable) is 


e T ~ tas where df = n—1. 

e For example, if we have a sample of size n=20 items, then we calculate 
the degrees of freedom as df=n—1=20-1=19 and we write the 
distribution as T' ~ ty9 


If the population standard deviation is not known, the error bound for 
a population mean is: 


Ja 
* 22S the t-score with area to the right equal to} 


- EBM = te - (4) 


e use df = n — 1 degrees of freedom 
e s =sample standard deviation 


Example: 
Exercise: 


Problem: 

Suppose you do a study of acupuncture to determine how effective it 
is in relieving pain. You measure sensory rates for 15 subjects with 
the results given below. Use the sample data to construct a 95% 
confidence interval for the mean sensory rate for the population 
(assumed normal) from which you took the data. 

8.6 9.4 7.9 6.8 8.3 7.3 9.2 9.6 8.7 11.4 10.3 5.4 8.1 5.5 6.9 


e The solution is shown step by step. 


Solution: 


To find the confidence interval, you need the sample mean, Z, and the 
EBM. 


G6 206 (ee os) eels 

di — 15 4 

CL=0.95 so a=1—CL=1—0.95 =0.05 
2=0.025 te =to95 


The area to the right of t.925 is 0.025 and the area to the left of t 925 is 
1-0.025=0.975 


te =t 25 = 2.14 using invI(.975,14) on the TI-84+ calculator. 


EBM = ta - (+) 


EBM = 2.14- ( 2922 ) — 0.924 
/15 


2— EB 3.2267 — 0.9240: — 7.3 


z+ EBM = 8.2267 + 0.9240 = 9.15 


The 95% confidence interval is (7.30, 9.15). 


We estimate with 95% confidence that the true population average 
sensory rate is between 7.30 and 9.15. 


Note: When calculating the error bound, a probability table for the 
Student-t distribution can also be used to find the value of t. The table 
gives t-scores that correspond to the confidence level (column) and 
degrees of freedom (row); the t-score is found where the row and 
column intersect in the table. 


Glossary 


Confidence Interval 
An interval estimate for unknown population parameter. This depends 
on: 


e The desired confidence level. 

e What is known for the distribution information (for ex., known 
variance). 

¢ Gathering from the sampling information. 


Confidence Level 
The percent expression for the probability that the confidence interval 
contains the true population parameter. That is, for ex., if CL=90%, 
then in 90 out of 100 samples the interval estimate will enclose the true 
population parameter. 


Degrees of Freedom (df) 
The number of objects in a sample that are free to vary. 


Error Bound for a Population Mean (EBM) 
The margin of error. Depends on the confidence level, sample size, and 
known or estimated population standard deviation. 


Normal Distribution 


A continuous random variable (RV) with pdf = 1_,—(x—)’/ 20" 


o/2n 
where py is the mean of the distribution and a is its standard deviation. 
Notation: X ~ N(u, a”). If ~ = O ando = 1, the RV is called 


standard normal distribution, or z-score. 


Standard Deviation 
A number that is equal to the square root of the variance and measures 
how far data values are from their mean. Notations: s for sample 
standard deviation and ofor population standard deviation. 


Student-t Distribution 
Investigated and reported by William S. Gossett in 1908 and published 
under the pseudonym Student. The major characteristics of the random 
variable (RV) are: 


e It is a continuous and assumes any real values. 

e The pdf is symmetrical about its mean of zero. However, it is 
more spread out and flatter at the apex than the normal 
distribution. 

e It approaches the standard normal distribution as n gets larger. 

e There is a "family" of t distributions: every representative of 
family is completely defined by the number of degrees of 
freedom which is one less than the number of data. 


Confidence Interval for a Population Proportion (modified R. Bloom) 

This module explains how to construct confidence interval estimates for a 
population proportion. The original module m16963 by B. Illowsky and S. 
Dean from the textbook collection Collaborative Statistics has been 
modified by R. Bloom to include step by step instructions for each problem. 
This updated version of the module now also includes calculation of the 
sample size needed to obtain a specified margin of error and confidence 
level. The context of one example has also been changed. 


During an election year, we see articles in the newspaper that state 
confidence intervals in terms of proportions or percentages. For example, a 
poll for a particular candidate running for president might show that the 
candidate has 40% of the vote within 3 percentage points. Often, election 
polls are calculated with 95% confidence. So, the pollsters would be 95% 
confident that the true proportion of voters who favored the candidate 
would be between 0.37 and 0.43 : (0.40 — 0.03, 0.40 + 0.03). 


Investors in the stock market are interested in the true proportion of stocks 
that go up and down each week. Businesses that sell personal computers are 
interested in the proportion of households in the United States that own 
personal computers. Confidence intervals can be calculated for the true 
proportion of stocks that go up or down each week and for the true 
proportion of households in the United States that own personal computers. 


The procedure to find the confidence interval, the sample size, the error 
bound, and the confidence level for a proportion is similar to that for the 
population mean. The formulas are different. 


How do you know you are dealing with a proportion problem? First, the 
underlying distribution is binomial. (There is no mention of a mean or 
average.) If X is a binomial random variable, then X~B(n, p) where n = 
the number of trials and p = the probability of a success. To form a 
proportion, take X, the random variable for the number of successes and 
divide it by n, the number of trials (or the sample size). The random 
variable P/ (read "P prime") is that proportion, 


Pi=s4 


n 


(Sometimes the random variable is written using the symbol P, read "P 
hat".) 


When n is large, we can use the normal distribution to approximate the 
binomial. 


If we divide all values of the random variable by n, the mean by n, and the 
standard deviation by n, we get a normal distribution of proportions with 
P1, called the estimated proportion, as the random variable. (Recall that a 
proportion = the number of successes divided by n.) 


X = pre w(22, 2F) 


n? n 


Using algebra to simplify : “** = ,/2% 


P? follows a normal distribution for proportions: P/ ~ N (», / Ba ) 


The confidence interval has the form (p/—EBP, p/+EBP). 


i 


p! = the estimated proportion of successes (p/ is a point estimate for p, 
the true proportion) 


x = the number of successes and n = the size of the sample 


The formula for the error bound for a proportion is 
EBP = ze fat @=1-—pl 


This formula is similar to the error bound formula for a mean, except that 
the "appropriate standard deviation" is different. For a mean, when the 
population standard deviation is known, the appropriate standard deviation 


that we use is i For a proportion, the appropriate standard deviation is 


Wi 


ae 
aoe 


- I-gl 
However, in the error bound formula, we use 4/ pe as the standard 


deviation, instead of / Pe 


In the error bound formula, the sample proportions p/ and q/ are 
estimates of the unknown population proportions p and gq. The estimated 
proportions p/ and q/ are used because p and q are not known. p/ and q/ are 
calculated from the data. p/ is the estimated proportion of successes. q/ is 
the estimated proportion of failures. 


Note:For the normal distribution of proportions, the z-score formula is as 
follows. 


If Pr~ N (», / Ba ) then the z-score formula is z = 2=2 


3 


al 


=| 


Example: 
Exercise: 


Problem: 


Suppose that a market research firm is hired to estimate the percent of 
adults living in a large city who have cell phones. 500 randomly 
selected adult residents this city are surveyed to determine whether 
they have cell phones. Of the 500 people surveyed, 421 responded yes 
- they own cell phones. Using a 95% confidence level, compute a 
confidence interval estimate for the true proportion of adults residents 
of this city who have cell phones. 


Solution: 


Let X = the number of people in the sample who have cell phones. X 
rae ; 421 

is binomial. X ~ B(500, sy): 

To calculate the confidence interval, you must find p/, q/, and EBP. 
n = 500 x = the number of successes = 421 


ie noe ole 
pl= 0.842 is the sample proportion; this is the point estimate of the 
population proportion. 


gi= 1 — pl= 1 — 0.842 = 0.158 


Since CL = 0.95, then 
a=1—CL=1-—0.95 = 0.05 = = 0.025. 


Use the TI-83, 83+ or 84+ calculator command invnorm(.975,0,1) to 
find z.925. Remember that the area to the right of z.925 is 0.025 and the 
area to the left of 2.925 is 0.975. This can also be found using 
appropriate commands on other calculators, using a computer, or 
using a Standard Normal probability table. 


EBD = oe 1) 2 6G. es) = 0.032 
2 n 500 


pI—EBP = 0.842 — 0.032 = 0.81 


pIt+EBP = 0.842 + 0.032 = 0.874 


The confidence interval for the true binomial population proportion is 
(p!—EBP, p/+EBP) =(0.810, 0.874). 


Interpretation 
We estimate with 95% confidence that between 81% and 87.4% of all 
adult residents of this city have cell phones. 


Explanation of 95% Confidence Level 

95% of the confidence intervals constructed in this way would contain 
the true value for the population proportion of all adult residents of 
this city who have cell phones. 


Example: 
Exercise: 


Problem: 


For a class project, a political science student at a large university 
wants to determine the percent of students that are registered voters. 
He surveys 500 students and finds that 300 are registered voters. 
Compute a 90% confidence interval for the true percent of students 
that are registered voters and interpret the confidence interval. 


Solution: 


x = 300 and n = 500. Using a TI-83+ or 84 calculator, the 90% 
confidence interval for the true percent of students that are registered 
voters is (0.564, 0.636). 


we a 
pi= = = 30 = 9.600 
qgi= 1 — pl= 1 — 0.600 = 0.400 


Since CL = 0.90, then 
a=1—CL=1-—0.90 = 0.10 ££ — 0.05. 


Use the TI-83, 83+ or 84+ calculator command invnorm(.95,0,1) to 
find z.95. Remember that the area to the right of z.95 is 0.05 and the 
area to the left of 2.95 is 0.95. This can also be found using 
appropriate commands on other calculators, using a computer, or 
using a Standard Normal probability table. 


(.60):(.40) 


/-gl 
EBP = 2 -«/ 2 =k. at 


= 0.036 


p!—EBP = 0.60 — 0.036 = 0.564 


pI+EBP = 0.60 + 0.036 = 0.636 
Interpretation: 


e We estimate with 90% confidence that the true percent of all 
students that are registered voters is between 56.4% and 63.6%. 

e Alternate Wording: We estimate with 90% confidence that 
between 56.4% and 63.6% of ALL students are registered voters. 


Explanation of 90% Confidence Level 

90% of all confidence intervals constructed in this way contain the 
true value for the population percent of students that are registered 
voters. 


Calculating the Sample Size 


If researchers desire a specific margin of error, then they can 
use the error bound formula to calculate the required sample 
size. 
The error bound formula for a proportion is 
EPBP Ze. / PY Solving for n gives you an equation 

2 n 


for the sample size: 


Example: 

Suppose a mobile phone company wants to determine the 
current percentage of customers aged 50+ that use text 
messaging on their cell phone. How many customers aged 
50+ should the company survey in order to be 90% 
confident that the estimated (sample) proportion is within 3 
percentage points of the true population proportion of 
customers aged 50+ that use text messaging on their cell 
phone. 

From the problem, we know that EBP=0.03 (3%=0.03) and 
Ze = 295 = 1.645 because the confidence level is 90% 


However, in order to find n , we need to know the 
estimated (sample) proportion p'. Remember that q'=1-p'. 
But, we do not know p' yet. Since we multiply p' and q' 
together, we make them both equal to 0.5 because p'q'= (.5) 
(.5)=.25 results in the largest possible product. (Try other 
products: (.6)(.4)=.24; (.3)(.7)=.21; (.2)(.8)=.16 and so on). 
The largest possible product gives us the largest n. This 
gives us a large enough sample so that we can be 90% 
confident that we are within 3 percentage points of the true 
population proportion. To calculate the sample size n, use 
the formula and make the substitutions. 

yea poe _ ee ee =751.7 

Round the answer to the next higher value. The sample size 


should be 758 cell phone customers aged 50+ in order to be 
90% confident that the estimated (sample) proportion is 
within 3 percentage points of the true population 
proportion of all customers aged 50+ that use text 
messaging on their cell phone. 


Glossary 


Binomial Distribution 
A discrete random variable (RV) which arises from the Bernoulli trials 
with the next additional requirements. There are fixed number, n, of 
independent trials. “Independent” means that the result to any trial (for 
example, trial 1) in no way affects the answer to all the following 
trials, and all trials are conducted under the same conditions. Under 
these circumstances the binomial RV X is defined as the number of 
success in n trials. The notation is: X~B(n, p); the domain is the mean 
is 4 = np, and the variance is 0? = df. The probability to have 


exactly x successes in 7 trials is P es = x) = () pq”. 


Confidence Interval 
An interval estimate for unknown population parameter. This depends 
on: 


e The desired confidence level. 

e What is known for the distribution information (for ex., known 
variance). 

e Gathering from the sampling information. 


Confidence Level 
The percent expression for the probability that the confidence interval 
contains the true population parameter. That is, for ex., if CL=90%, 
then in 90 out of 100 samples the interval estimate will enclose the true 
population parameter. 


Error Bound for a Population Proportion (EBP) 
The margin of error. Depends on the confidence level, sample size, and 
estimated population proportion. 


Normal Distribution 


A continuous random variable (RV) with pdf = Te e~ (eH)? /20° 


where py is the mean of the distribution and a is its standard deviation. 


’ 


Notation: X ~ N(u, a) If uw = 0 ando = 1, the RV is called 
standard normal distribution, or z-score. 


Summary of Formulas 

Formula General form of a confidence interval 

(lower value, upper value) = (point estimate — error bound, point estimate + error bound) 
FormulaTo find the error bound when you know the confidence interval 


error bound = upper value — point estimate OR 


écror bound — upper eine fore value 


FormulaSingle Population Mean, Known Standard Deviation, Normal Distribution 
Use the Normal Distribution for Means EBM =72 Vn 
The confidence interval has the format ( - EBM, # + EBM). 


FormulaSingle Population Mean, Unknown Standard Deviation, Student's-t Distribution 


Use the Student's-t Distribution with degrees of freedom df = n — 1. EBM = fz - A 


FormulaSingle Population Proportion, Normal Distribution 


Use the Normal Distribution for a single population proportion pl= = 


EBP =z2-,/7" — pr+qr=1 


The confidence interval has the format (p/—EBP, p/+-EBP). 
FormulaPoint Estimates 

Z is a point estimate for yz 

p!/is a point estimate for p 


s is a point estimate for 7 


Practice 1: Confidence Intervals for Averages, Known Population Standard 
Deviation 


Student Learning Outcomes 


e The student will calculate confidence intervals for means when the 
population standard deviation is known. 


Given 


The mean age for all Foothill College students for a recent Fall term was 
33.2. The population standard deviation has been pretty consistent at 15. 
Suppose that twenty-five Winter students were randomly selected. The 
mean age for the sample was 30.4. We are interested in the true mean age 
for Winter Foothill College students. 

(http://research.fhda.edu/factbook/FH Demo _Trends/FoothillDemographic 
Trends.htm 


Let X = the age of a Winter Foothill College student 


Calculating the Confidence Interval 


Exercise: 


Problem: x = 


Solution: 


30.4 


Exercise: 


Problem: n= 


Solution: 


25 


Exercise: 


Problem: 15=(insert symbol here) 


Solution: 


oO 


Exercise: 


Problem: Define the Random Variable, X , in words. 
X= 
Solution: 


the mean age of 25 randomly selected Winter Foothill students 


Exercise: 


Problem: What is x estimating? 
Solution: 


LL 
Exercise: 


Problem: Is 7 ,, known? 
Solution: 


yes 


Exercise: 


Problem: 


As aresult of your answer to (4), state the exact distribution to use 
when calculating the Confidence Interval. 


Solution: 


Normal 


Explaining the Confidence Interval 


Construct a 95% Confidence Interval for the true mean age of Winter 
Foothill College students. 
Exercise: 


Problem: How much area is in both tails (combined)? a = __ 


Solution: 


0.05 


Exercise: 


Problem: How much area is in each tail? > = 


Solution: 


0.025 


Exercise: 
Problem: Identify the following specifications: 
e a lower limit = 


¢ b upper limit = 
e cerror bound = 


Solution: 


e a24.52 
° b36.28 
e c5.88 


Exercise: 


Problem: The 95% Confidence Interval is: 
Solution: 


(24.52,36.28) 
Exercise: 
Problem: 


Fill in the blanks on the graph with the areas, upper and lower 
limits of the Confidence Interval, and the sample mean. 


ae CL.= = 
z2 | nn 2 


Exercise: 
Problem: In one complete sentence, explain what the interval means. 


Discussion Questions 


Exercise: 


Problem: 


Using the same mean, standard deviation and level of confidence, 
suppose that n were 69 instead of 25. Would the error bound become 
larger or smaller? How do you know? 


Exercise: 
Problem: 
Using the same mean, standard deviation and sample size, how would 


the error bound change if the confidence level were reduced to 90%? 
Why? 


Practice 2: Confidence Intervals for Averages, Unknown Population 
Standard Deviation 


Student Learning Outcomes 


e The student will calculate confidence intervals for means when the 
population standard deviation is unknown. 


Given 


The following real data are the result of a random survey of 39 national 
flags (with replacement between picks) from various countries. We are 
interested in finding a confidence interval for the true mean number of 
colors on a national flag. Let X = the number of colors on a national flag. 


xX Freq. 
1 1 

2 7 

3 18 

4 7 

5 6 


Calculating the Confidence Interval 


Exercise: 


Problem: Calculate the following: 


e at= 
e bs, = 
e* cn = 


Solution: 


e a3.26 
e b1.02 
e ¢39 


Exercise: 


Problem: 


Define the Random Variable, X, in words. X = 


Solution: 


the mean number of colors of 39 flags 


Exercise: 


Problem: What is Z estimating? 
Solution: 


LL 
Exercise: 


Problem: Is 7 ,, known? 


Solution: 


No 
Exercise: 


Problem: 


As aresult of your answer to (4), state the exact distribution to use 
when calculating the Confidence Interval. 


Solution: 


t38 


Confidence Interval for the True Mean Number 


Construct a 95% Confidence Interval for the true mean number of colors on 
national flags. 
Exercise: 


Problem: How much area is in both tails (combined)? a = 


Solution: 
0.05 


Exercise: 


Problem: How much area is in each tail? > = 


Solution: 
0.025 
Exercise: 
Problem: Calculate the following: 


e alower limit = 


¢ bupper limit = 
e cerror bound = 


Solution: 


e a2.93 
e b3.59 
e 0.33 


Exercise: 


Problem: The 95% Confidence Interval is: 
Solution: 


2.93: 3.59 
Exercise: 


Problem: 


Fill in the blanks on the graph with the areas, upper and lower limits of 
the Confidence Interval and the sample mean. 


= = é3 = 
2 2 


Exercise: 
Problem: In one complete sentence, explain what the interval means. 


Discussion Questions 


Exercise: 
Problem: 
Using the same Z, s,, and level of confidence, suppose that nm were 69 


instead of 39. Would the error bound become larger or smaller? How 
do you know? 


Exercise: 
Problem: 


Using the same 7, s,, and n = 39, how would the error bound change 
if the confidence level were reduced to 90%? Why? 


Practice 3: Confidence Intervals for Proportions 


Student Learning Outcomes 


e The student will calculate confidence intervals for proportions. 


Given 


The Ice Chalet offers dozens of different beginning ice-skating classes. All 
of the class names are put into a bucket. The 5 P.M., Monday night, ages 8 - 
12, beginning ice-skating class was picked. In that class were 64 girls and 
16 boys. Suppose that we are interested in the true proportion of girls, ages 
8 - 12, in all beginning ice-skating classes at the Ice Chalet. Assume that the 
children in the selected class is a random sample of the population. 


Estimated Distribution 
Exercise: 
Problem: What is being counted? 
Exercise: 
Problem: In words, define the Random Variable X.X = 


Solution: 
The number of girls, age 8-12, in the beginning ice skating class 
Exercise: 
Problem: Calculate the following: 
eaxrt=— 


e bn= 
e Cc piI= 


Solution: 


e a64 
e b80 
e c0.8 


Exercise: 


Problem: State the estimated distribution of X.X ~ 


Solution: 
B(80, 0.80) 
Exercise: 
Problem: Define a new Random Variable P/. What is p/ estimating? 
Solution: 


Pp 
Exercise: 


Problem: In words, define the Random Variable P/ . P/= 
Solution: 


The proportion of girls, age 8-12, in the beginning ice skating class. 


Exercise: 


Problem: State the estimated distribution of P/. P!~ 


Explaining the Confidence Interval 


Construct a 92% Confidence Interval for the true proportion of girls in the 
age 8 - 12 beginning ice-skating classes at the Ice Chalet. 
Exercise: 


Problem: How much area is in both tails (combined)? a = 


Solution: 
1 - 0.92 = 0.08 
Exercise: 


Problem: How much area is in each tail? = = 


Solution: 
0.04 
Exercise: 

Problem: Calculate the following: 
e alower limit = 
¢ bupper limit = 
e cerror bound = 

Solution: 


e a0.72 
e b0.88 
e c0.08 


Exercise: 


Problem: The 92% Confidence Interval is: 


Solution: 


(0.72; 0.88) 
Exercise: 


Problem: 
Fill in the blanks on the graph with the areas, upper and lower 


limits of the Confidence Interval, and the sample proportion. 
a 


a L= a 
27-——  h__ y= 


Exercise: 


Problem: In one complete sentence, explain what the interval means. 


Discussion Questions 


Exercise: 
Problem: 
Using the same p/ and level of confidence, suppose that n were 


increased to 100. Would the error bound become larger or smaller? 
How do you know? 


Exercise: 
Problem: 
Using the same p/ and n = 80, how would the error bound change if 
the confidence level were increased to 98%? Why? 


Exercise: 


Problem: 


If you decreased the allowable error bound, why would the minimum 
sample size increase (keeping the same level of confidence)? 


Confidence Interval Homework Link (Collaborative Statistics; R. Bloom 
custom version) 


Link to homework questions in Homework Collection/Book for Confidence 
Intervals Chapter 8 of Collaborative Statistics for R. Bloom 


Chapter 8 Review Questions Link (Collaborative Statistics; R. Bloom 
custom version) 


Link to Review Questions in Homework Collection/Book for Confidence 
Intervals Chapter 8 of Collaborative Statistics for R. Bloom 


Chapter 8 Review Questions (_http://cnx.org/content/m19018/latest/ ) 


Hypothesis Testing: Single Mean and Single Proportion 


Student Learning Outcomes 
By the end of this chapter, the student should be able to: 


e Differentiate between Type I and Type II Errors 

e Describe hypothesis testing in general and in practice 

e Conduct and interpret hypothesis tests for a single population mean, 
population standard deviation known. 

¢ Conduct and interpret hypothesis tests for a single population mean, 
population standard deviation unknown. 

¢ Conduct and interpret hypothesis tests for a single population 
proportion. 


Introduction 


One job of a Statistician is to make statistical inferences about populations 
based on samples taken from the population. Confidence intervals are one 
way to estimate a population parameter. Another way to make a Statistical 
inference is to make a decision about a parameter. For instance, a car dealer 
advertises that its new small truck gets 35 miles per gallon, on the average. 
A tutoring service claims that its method of tutoring helps 90% of its 
students get an A or a B. A company says that women managers in their 
company earn an average of $60,000 per year. 


A Statistician will make a decision about these claims. This process is called 
"hypothesis testing." A hypothesis test involves collecting data from a 
sample and evaluating the data. Then, the statistician makes a decision as to 
whether or not there is sufficient evidence based upon analyses of the data, 
to reject the null hypothesis. 


In this chapter, you will conduct hypothesis tests on single means and single 
proportions. You will also learn about the errors associated with these tests. 


Hypothesis testing consists of two contradictory hypotheses or statements, a 
decision based on the data, and a conclusion. To perform a hypothesis test, a 


Statistician will: 


1. Set up two contradictory hypotheses. 

2. Collect sample data (in homework problems, the data or summary 
Statistics will be given to you). 

3. Determine the correct distribution to perform the hypothesis test. 

4. Analyze sample data by performing the calculations that ultimately 
will allow you to reject or fail to reject the null hypothesis. 

5. Make a decision and write a meaningful conclusion. 


Note:To do the hypothesis test homework problems for this chapter and 
later chapters, make copies of the appropriate special solution sheets. See 
the Table of Contents topic "Solution Sheets". 


Glossary 


Confidence Interval (CI) 
An interval estimate for an unknown population parameter. This 


depends on: 


e The desired confidence level. 

e Information that is known about the distribution (for example, 
known standard deviation). 

e The sample and its size. 


Hypothesis Testing 
Based on sample evidence, a procedure to determine whether the 
hypothesis stated is a reasonable statement and cannot be rejected, or 
is unreasonable and should be rejected. 


Null and Alternate Hypotheses 


The actual test begins by considering two hypotheses. They are called the 
null hypothesis and the alternate hypothesis. These hypotheses contain 
opposing viewpoints. 


H,: The null hypothesis: It is a statement about the population that will be 
assumed to be true unless it can be shown to be incorrect beyond a 
reasonable doubt. 


H{,: The alternate hypothesis: It is a claim about the population that is 
contradictory to H, and what we conclude when we reject Ho. 


Example: 

H,: No more than 30% of the registered voters in Santa Clara County 
voted in the primary election. 

Hf,: More than 30% of the registered voters in Santa Clara County voted in 
the primary election. 


Example: 

We want to test whether the mean grade point average in American 
colleges is different from 2.0 (out of 4.0). 

a ft — 2.0 lage Mise Bal) 


Example: 

We want to test if college students take less than five years to graduate 
from college, on the average. 

ed 5 0 Jib [he 


Example: 


In an issue of U. S. News and World Report, an article on school 
standards stated that about half of all students in France, Germany, and 
Israel take advanced placement exams and a third pass. The same article 
stated that 6.6% of U. S. students take advanced placement exams and 4.4 
% pass. Test if the percentage of U. S. students who take advanced 
placement exams is more than 6.6%. 

A,: p= 0.066 Ha: p > 0.066 


Since the null and alternate hypotheses are contradictory, you must examine 
evidence to decide if you have enough evidence to reject the null hypothesis 
or not. The evidence is in the form of sample data. 


After you have determined which hypothesis the sample supports, you 
make a decision. There are two options for a decision. They are "reject H," 
if the sample information favors the alternate hypothesis or "do not reject 
Hf," or "fail to reject H," if the sample information is insufficient to reject 
the null hypothesis. 


Mathematical Symbols Used in H, and A: 


isk A, 


- not equal (+) or greater than (>) or less 
ce) than (<) 
greater than or equal 
to) less than (<) 
less than or equal to ( 


<) more than (>) 


Note: 1, always has a symbol with an equal in it. H, never has a symbol 
with an equal in it. The choice of symbol depends on the wording of the 
hypothesis test. However, be aware that many researchers (including one of 
the co-authors in research work) use = in the Null Hypothesis, even with 
> or < as the symbol in the Alternate Hypothesis. This practice is 
acceptable because we only make the decision to reject or not reject the 
Null Hypothesis. 


Optional Collaborative Classroom Activity 


Bring to class a newspaper, some news magazines, and some Internet 
articles . In groups, find articles from which your group can write a null and 
alternate hypotheses. Discuss your hypotheses with the rest of the class. 


Glossary 


Hypothesis 
A statement about the value of a population parameter. In case of two 
hypotheses, the statement assumed to be true is called the null 
hypothesis (notation Ho) and the contradictory statement is called the 
alternate hypothesis (notation H,). 


Outcomes and the Type I and Type II Errors 


When you perform a hypothesis test, there are four possible outcomes 
depending on the actual truth (or falseness) of the null hypothesis H, and 
the decision to reject or not. The outcomes are summarized in the following 
table: 


ACTION H, 1S ACTUALLY 

True False 
Do not reject H, Correct Outcome Type II error 
Reject H, Type I Error Correct Outcome 


The four possible outcomes in the table are: 


e The decision is to not reject H, when, in fact, H, is true (correct 
decision). 

e The decision is to reject H, when, in fact, H, is true (incorrect 
decision known as a Type I error). 

e The decision is to not reject H, when, in fact, H, is false (incorrect 
decision known as a Type I error). 

e The decision is to reject H, when, in fact, H, is false (correct 
decision whose probability is called the Power of the Test). 


Each of the errors occurs with a particular probability. The Greek letters a 
and @ represent the probabilities. 


qa = probability of a Type I error = P(Type I error) = probability of 
rejecting the null hypothesis when the null hypothesis is true. 


@ = probability of a Type II error = P(Type II error) = probability of not 
rejecting the null hypothesis when the null hypothesis is false. 


a and £ should be as small as possible because they are probabilities of 
errors. They are rarely 0. 


The Power of the Test is 1 — @. Ideally, we want a high power that is as 
close to 1 as possible. Increasing the sample size can increase the Power of 
the Test. 


The following are examples of Type I and Type II errors. 


Example: 

Suppose the null hypothesis, Ho, is: Frank's rock climbing equipment is 
safe. 

Type I error: Frank thinks that his rock climbing equipment may not be 
safe when, in fact, it really is safe. Type II error: Frank thinks that his 
rock climbing equipment may be safe when, in fact, it is not safe. 

qa = probability that Frank thinks his rock climbing equipment may not be 
safe when, in fact, it really is safe. 6 = probability that Frank thinks his 
rock climbing equipment may be safe when, in fact, it is not safe. 

Notice that, in this case, the error with the greater consequence is the Type 
II error. (If Frank thinks his rock climbing equipment is safe, he will go 
ahead and use it.) 


Example: 

Suppose the null hypothesis, H,, is: The victim of an automobile accident 
is alive when he arrives at the emergency room of a hospital. 

Type I error: The emergency crew thinks that the victim is dead when, in 
fact, the victim is alive. Type II error: The emergency crew does not 
know if the victim is alive when, in fact, the victim is dead. 

qa = probability that the emergency crew thinks the victim is dead when, 
in fact, he is really alive = P(Type I error). G = probability that the 


emergency crew does not know if the victim is alive when, in fact, the 
victim is dead = P(Type IJ error). 

The error with the greater consequence is the Type I error. (If the 
emergency crew thinks the victim is dead, they will not treat him.) 


Glossary 


Type 1 Error 
The decision is to reject the Null hypothesis when, in fact, the Null 


hypothesis is true. 


Type 2 Error 
The decision is to not reject the Null hypothesis when, in fact, the Null 


hypothesis is false. 


Distribution Needed for Hypothesis Testing 


Earlier in the course, we discussed sampling distributions. Particular 
distributions are associated with hypothesis testing. Perform tests of a 
population mean using a normal distribution or a student's-t 
distribution. (Remember, use a student's-t distribution when the population 
standard deviation is unknown and the distribution of the sample mean is 
approximately normal.) In this chapter we perform tests of a population 
proportion using a normal distribution (usually n is large or the sample size 
is large). 


If you are testing a single population mean, the distribution for the test is 
for means: 


A N(ux, 3) or tar 


The population parameter is jz. The estimated value (point estimate) for pu is 
x, the sample mean. 


If you are testing a single population proportion, the distribution for the 
test is for proportions or percentages: 


Pwo) 


The population parameter is p. The estimated value (point estimate) for p is 
p’. p’ = = where z is the number of successes and n is the sample size. 


Glossary 


Normal Distribution 
A continuous random variable (RV) with pdf 


Ex) = i e (eH)"/ 20" where yz is the mean of the distribution and 


o is the standard deviation. Notation: X ~ N(y, 0). If uw = 0 and 
o = 1, the RV is called the standard normal distribution. 


Standard Deviation 
A number that is equal to the square root of the variance and measures 
how far data values are from their mean. Notation: s for sample 
standard deviation and o for population standard deviation. 


Student's-t Distribution 
Investigated and reported by William S. Gossett in 1908 and published 
under the pseudonym Student. The major characteristics of the random 
variable (RV) are: 


e It is continuous and assumes any real values. 

e The pdf is symmetrical about its mean of zero. However, it is 
more spread out and flatter at the apex than the normal 
distribution. 

e It approaches the standard normal distribution as n gets larger. 

e There is a "family" of t distributions: every representative of the 
family is completely defined by the number of degrees of 
freedom which is one less than the number of data. 


Assumption 


When you perform a hypothesis test of a single population mean py using 
a Student's-t distribution (often called a t-test), there are fundamental 
assumptions that need to be met in order for the test to work properly. Your 
data should be a simple random sample that comes from a population that 
is approximately normally distributed. You use the sample standard 
deviation to approximate the population standard deviation. (Note that if 
the sample size is sufficiently large, a t-test will work even if the population 
is not approximately normally distributed). 


When you perform a hypothesis test of a single population mean jy using 
a normal distribution (often called a z-test), you take a simple random 
sample from the population. The population you are testing is normally 
distributed or your sample size is sufficiently large. You know the value of 
the population standard deviation. 


When you perform a hypothesis test of a single population proportion p, 
you take a simple random sample from the population. You must meet the 
conditions for a binomial distribution which are there are a certain number 
n of independent trials, the outcomes of any trial are success or failure, and 
each trial has the same probability of a success p. The shape of the binomial 
distribution needs to be similar to the shape of the normal distribution. To 
ensure this, the quantities np and nq must both be greater than five (np > 5 
and nq > 5). Then the binomial distribution of sample (estimated) 
proportion can be approximated by the normal distribution with 4 = p and 


o = ,/**. Remember that g = 1 — p. 


Glossary 


Binomial Distribution 
A discrete random variable (RV) which arises from Bernoulli trials. 
There are a fixed number, n, of independent trials. “Independent” 
means that the result of any trial (for example, trial 1) does not affect 
the results of the following trials, and all trials are conducted under the 
same conditions. Under these circumstances the binomial RV X is 


defined as the number of successes in 7 trials. The notation is: X~ 
B(n, p). The mean is js = np and the standard deviation is o = ,/npq 
. The probability of exactly z successes in 7 trials is 


P(X = 2) = (1 )p*q"*. 


Normal Distribution 
A continuous random variable (RV) with pdf 


fx) = Sr e~(*-H)?/20° | where jy. is the mean of the distribution and 


o is the standard deviation. Notation: X ~ N(y, 0). If uw = 0 and 
ao = 1, the RV is called the standard normal distribution. 


Standard Deviation 
A number that is equal to the square root of the variance and measures 
how far data values are from their mean. Notation: s for sample 
standard deviation and o for population standard deviation. 


Student-t Distribution 
Investigated and reported by William S. Gossett in 1908 and published 
under the pseudonym Student. The major characteristics of the random 
variable (RV) are: 


e It is continuous and assumes any real values. 

e The pdf is symmetrical about its mean of zero. However, it is 
more spread out and flatter at the apex than the normal 
distribution. 

e It approaches the standard normal distribution as n gets larger. 

e There is a "family" of t distributions: every representative of the 
family is completely defined by the number of degrees of 
freedom which is one less than the number of data. 


Rare Events 


Suppose you make an assumption about a property of the population (this 
assumption is the null hypothesis). Then you gather sample data randomly. 
If the sample has properties that would be very unlikely to occur if the 
assumption is true, then you would conclude that your assumption about the 
population is probably incorrect. (Remember that your assumption is just an 
assumption - it is not a fact and it may or may not be true. But your sample 
data are real and the data are showing you a fact that seems to contradict 
your assumption. ) 


For example, Didi and Ali are at a birthday party of a very wealthy friend. 
They hurry to be first in line to grab a prize from a tall basket that they 
cannot see inside because they will be blindfolded. There are 200 plastic 
bubbles in the basket and Didi and Ali have been told that there is only one 
with a $100 bill. Didi is the first person to reach into the basket and pull out 
a bubble. Her bubble contains a $100 bill. The probability of this happening 
is sr = 0.005. Because this is so unlikely, Ali is hoping that what the two 


of them were told is wrong and there are more $100 bills in the basket. A 
"rare event" has occurred (Didi getting the $100 bill) so Ali doubts the 
assumption about only one $100 bill being in the basket. 


Glossary 


Hypothesis 
A statement about the value of a population parameter. In case of two 
hypotheses, the statement assumed to be true is called the null 
hypothesis (notation Ho) and the contradictory statement is called the 
alternate hypothesis (notation H,). 


Using the Sample to Support One of the Hypotheses 


Use the sample data to calculate the actual probability of getting the test 
result, called the p-value. The p-value is the probability that, if the null 
hypothesis is true, the results from another randomly selected sample 
will be as extreme or more extreme as the results obtained from the 
given sample. 


A large p-value calculated from the data indicates that we should fail to 
reject the null hypothesis. The smaller the p-value, the more unlikely the 
outcome, and the stronger the evidence is against the null hypothesis. We 
would reject the null hypothesis if the evidence is strongly against it. 


Draw a graph that shows the p-value. The hypothesis test is easier to 
perform if you use a graph because you see the problem more clearly. 


Example: 
(to illustrate the p-value) 
Suppose a baker claims that his bread height is more than 15 cm, on the 
average. Several of his customers do not believe him. To persuade his 
customers that he is right, the baker decides to do a hypothesis test. He 
bakes 10 loaves of bread. The mean height of the sample loaves is 17 cm. 
The baker knows from baking hundreds of loaves of bread that the 
standard deviation for the height is 0.5 cm. and the distribution of heights 
is normal. 
The null hypothesis could be H,: ~ < 15 The alternate hypothesis is H,: 
Tes 
The words "is more than" translates as a'">" so "~ > 15" goes into the 
alternate hypothesis. The null hypothesis must contradict the alternate 
hypothesis. 
Since o is known (o0 = 0.5 cm.), the distribution for the population is 
known to be normal with mean = 15 and standard deviation = 

0.5 
Suppose the null hypothesis is true (the mean height of the loaves is no 
more than 15 cm). Then is the mean height (17 cm) calculated from the 


sample unexpectedly large? The hypothesis test works by asking the 
question how unlikely the sample mean would be if the null hypothesis 
were true. The graph shows how far out the sample mean is on the normal 
curve. The p-value is the probability that, if we were to take other samples, 
any other sample mean would fall at least as far out as 17 cm. 

The p-value, then, is the probability that a sample mean is the same or 
greater than 17 cm. when the population mean is, in fact, 15 cm. We 
can calculate this probability using the normal distribution for means from 
Chapter 7. 


p-value is 
approximately 0 


15 17 


p-value = P(x > 17) which is approximately 0. 

A p-value of approximately 0 tells us that it is highly unlikely that a loaf of 
bread rises no more than 15 cm, on the average. That is, almost 0% of all 
loaves of bread would be at least as high as 17 cm. purely by CHANCE 
had the population mean height really been 15 cm. Because the outcome of 
17 cm. is so unlikely (meaning it is happening NOT by chance alone), 
we conclude that the evidence is strongly against the null hypothesis (the 
mean height is at most 15 cm.). There is sufficient evidence that the true 
mean height for the population of the baker's loaves of bread is greater than 
15 cm. 


Glossary 


Hypothesis 
A statement about the value of a population parameter. In case of two 
hypotheses, the statement assumed to be true is called the null 
hypothesis (notation Ho) and the contradictory statement is called the 
alternate hypothesis (notation H,). 


p-value 
The probability that an event will happen purely by chance assuming 
the null hypothesis is true. The smaller the p-value, the stronger the 
evidence is against the null hypothesis. 


Standard Deviation 
A number that is equal to the square root of the variance and measures 
how far data values are from their mean. Notation: s for sample 
standard deviation and o for population standard deviation. 


Decision and Conclusion 


A systematic way to make a decision of whether to reject or not reject the 
null hypothesis is to compare the p-value and a preset or preconceived a 
(also called a "significance level"). A preset a is the probability of a Type 
L error (rejecting the null hypothesis when the null hypothesis is true). It 
may or may not be given to you at the beginning of the problem. 


When you make a decision to reject or not reject Ho, do as follows: 


e If a > p-value, reject H,. The results of the sample data are 
significant. There is sufficient evidence to conclude that H, is an 
incorrect belief and that the alternative hypothesis, H,, may be 
correct. 

e If a < p-value, do not reject H,. The results of the sample data are 
not significant. There is not sufficient evidence to conclude that the 
alternative hypothesis, H,, may be correct. 

e When you "do not reject H,", it does not mean that you should believe 
that H, is true. It simply means that the sample data have failed to 
provide sufficient evidence to cast serious doubt about the truthfulness 
Ol ff is 


Conclusion: After you make your decision, write a thoughtful conclusion 
about the hypotheses in terms of the given problem. 


Glossary 


Hypothesis 
A statement about the value of a population parameter. In case of two 
hypotheses, the statement assumed to be true is called the null 
hypothesis (notation Ho) and the contradictory statement is called the 
alternate hypothesis (notation H,). 


Level of Significance of the Test 
Probability of a Type I error (reject the null hypothesis when it is true). 
Notation: a. In hypothesis testing, the Level of Significance is called 
the preconceived a or the preset a. 


p-value 
The probability that an event will happen purely by chance assuming 
the null hypothesis is true. The smaller the p-value, the stronger the 
evidence is against the null hypothesis. 


Type 1 Error 
The decision is to reject the Null hypothesis when, in fact, the Null 
hypothesis is true. 


Additional Information 


In a hypothesis test problem, you may see words such as "the level of 
significance is 1%." The "1%" is the preconceived or preset a. 

The statistician setting up the hypothesis test selects the value of a@ to 
use before collecting the sample data. 

If no level of significance is given, the accepted standard is to use 
a = 0.05. 

When you calculate the p-value and draw the picture, the p-value is 
the area in the left tail, the right tail, or split evenly between the two 
tails. For this reason, we call the hypothesis test left, right, or two 
tailed. 

The alternate hypothesis, H,, tells you if the test is left, right, or two- 
tailed. It is the key to conducting the appropriate test. 

Hf, never has a symbol that contains an equal sign. 

Thinking about the meaning of the p-value: A data analyst (and 
anyone else) should have more confidence that he made the correct 
decision to reject the null hypothesis with a smaller p-value (for 
example, 0.001 as opposed to 0.04) even if using the 0.05 level for 
alpha. Similarly, for a large p-value like 0.4, as opposed to a p-value of 
0.056 (alpha = 0.05 is less than either number), a data analyst should 
have more confidence that she made the correct decision in failing to 
reject the null hypothesis. This makes the data analyst use judgment 
rather than mindlessly applying rules. 


The following examples illustrate a left, right, and two-tailed test. 


Example: 

Gt 0 Vela (Ve <5) 

Test of a single population mean. H, tells you the test is left-tailed. The 
picture of the p-value is as follows: 


p-value 


4 | 


Example: 

ig p= 0:2 ip. 0:2 

This is a test of a single population proportion. H, tells you the test is 
right-tailed. The picture of the p-value is as follows: 


p-value 


0.2 


Example: 

a: ff = 50 Ha? jb 50 

This is a test of a single population mean. H, tells you the test is two- 
tailed. The picture of the p-value is as follows. 


l l 
— (p-value — p-value) 
5 (p-value) 5 | 


4 | 


50 


Glossary 


Hypothesis Testing 
Based on sample evidence, a procedure to determine whether the 
hypothesis stated is a reasonable statement and cannot be rejected, or 
is unreasonable and should be rejected. 


p-value 
The probability that an event will happen purely by chance assuming 
the null hypothesis is true. The smaller the p-value, the stronger the 
evidence is against the null hypothesis. 


Summary of the Hypothesis Test 


The hypothesis test itself has an established process. This can be 
summarized as follows: 


. Determine H, and H,. Remember, they are contradictory. 

. Determine the random variable. 

. Determine the distribution for the test. 

. Draw a graph, calculate the test statistic, and use the test statistic to 
calculate the p-value. (A z-score and a t-score are examples of test 
Statistics.) 

5. Compare the preconceived @ with the p-value, make a decision (reject 

or do not reject H,), and write a clear conclusion using English 

sentences. 


BRWN FP 


Notice that in performing the hypothesis test, you use @ and not £. is 
needed to help determine the sample size of the data that is used in 
calculating the p-value. Remember that the quantity 1 — £ is called the 
Power of the Test. A high power is desirable. If the power is too low, 
Statisticians typically increase the sample size while keeping a the same. If 
the power is low, the null hypothesis might not be rejected when it should 
be. 


Glossary 


Hypothesis Testing 
Based on sample evidence, a procedure to determine whether the 
hypothesis stated is a reasonable statement and cannot be rejected, or 
is unreasonable and should be rejected. 


p-value 
The probability that an event will happen purely by chance assuming 
the null hypothesis is true. The smaller the p-value, the stronger the 
evidence is against the null hypothesis. 


Examples 

This module provides examples of Hypothesis Testing of a Single Mean 
and a Single Proportion as a part of the Collaborative Statistics collection 
(col10522) by Barbara Illowsky and Susan Dean. 


Example: 
Exercise: 


Problem: 


Jeffrey, as an eight-year old, established a mean time of 16.43 
seconds for swimming the 25-yard freestyle, with a standard 
deviation of 0.8 seconds. His dad, Frank, thought that Jeffrey could 
swim the 25-yard freestyle faster by using goggles. Frank bought 
Jeffrey a new pair of expensive goggles and timed Jeffrey for 15 25- 
yard freestyle swims. For the 15 swims, Jeffrey's mean time was 16 
seconds. Frank thought that the goggles helped Jeffrey to swim 
faster than the 16.43 seconds. Conduct a hypothesis test using a 
preset a = 0.05. Assume that the swim times for the 25-yard 
freestyle are normal. 


Solution: 
Set up the Hypothesis Test: 


Since the problem is about a mean, this is a test of a single 
population mean. 


Ho: u=16.43 Ha:w< 16.43 


For Jeffrey to swim faster, his time will be less than 16.43 seconds. 
The "<" tells you this is left-tailed. 


Determine the distribution needed: 


Random variable: X = the mean time to swim the 25-yard freestyle. 


Distribution for the test: X is normal (population standard 
deviation is known: o = 0.8) 


ee N(n, x) Therefore, X ~ N (16.43, 8. 


jt = 16.43 comes from AH and not the data. o = 0.8, andn = 15. 
Calculate the p-value using the normal distribution for a mean: 
p-value = P(a << 16) = 0.0187 where the sample mean in the 
problem is given as 16. 


p-value = 0.0187 (This is called the actual level of significance.) 
The p-value is the area to the left of the sample mean is given as 16. 


Graph: 
p-value - 
x= 16 
nw = 16.43 
16 16.43 ss 


jt = 16.43 comes from H,. Our assumption is wy = 16.43. 
Interpretation of the p-value: If H, is true, there is a 0.0187 
probability (1.87%) that Jeffrey's mean time to swim the 25-yard 
freestyle is 16 seconds or less. Because a 1.87% chance is small, the 


mean time of 16 seconds or less is unlikely to have happened 
randomly. It is a rare event. 


Compare q@ and the p-value: 
a = 0.05 p-value = 0.0187 a > p-value 


Make a decision: Since a > p-value, reject Ho. 


This means that you reject 44 = 16.43. In other words, you do not 
think Jeffrey swims the 25-yard freestyle in 16.43 seconds but faster 
with the new goggles. 


Conclusion: At the 5% significance level, we conclude that Jeffrey 
swims faster using the new goggles. The sample data show there is 
sufficient evidence that Jeffrey's mean time to swim the 25-yard 
freestyle is less than 16.43 seconds. 


The p-value can easily be calculated using the TI-83+ and the TI-84 
calculators: 


Press STAT and arrow over to TESTS. Press 1:Z-Test. Arrow over 
to Stats and press ENTER. Arrow down and enter 16.43 for fp (null 
hypothesis), .8 for 0, 16 for the sample mean, and 15 for n. Arrow 
down to p: (alternate hypothesis) and arrow over to <fg. Press 
ENTER. Arrow down to Calculate and press ENTER. The 
calculator not only calculates the p-value (p = 0.0187) but it also 
calculates the test statistic (z-score) for the sample mean.  < 16.43 
is the alternate hypothesis. Do this set of instructions again except 
arrow to Draw (instead of Calculate). Press ENTER. A shaded 
graph appears with z = —2.08 (test statistic) and p = 0.0187 (p- 
value). Make sure when you use Dr aw that no other equations are 
highlighted in Y = and the plots are turned off. 


When the calculator does a Z-Test, the Z- Test function finds the p- 
value by doing a normal probability calculation using the Central 
Limit Theorem: 


2 -op—2nd DISTR normcdf 
(—10 WHA 16.43, 0.8/V15). 
The Type I and Type IJ errors for this problem are as follows: 


The Type I error is to conclude that Jeffrey swims the 25-yard 
freestyle, on average, in less than 16.43 seconds when, in fact, he 


actually swims the 25-yard freestyle, on average, in 16.43 seconds. 
(Reject the null hypothesis when the null hypothesis is true.) 


The Type II error is that there is not evidence to conclude that Jeffrey 
swims the 25-yard free-style, on average, in less than 16.43 seconds 
when, in fact, he actually does swim the 25-yard free-style, on 
average, in less than 16.43 seconds. (Do not reject the null hypothesis 
when the null hypothesis is false.) 


Historical Note: The traditional way to compare the two probabilities, a 
and the p-value, is to compare the critical value (z-score from q) to the test 
Statistic (z-score from data). The calculated test statistic for the p-value is 
—2.08. (From the Central Limit Theorem, the test statistic formula is 


(=) . For this problem, x = 16, wx = 16.43 from the null 
hypothesis, ox = 0.8, and m = 15.) You can find the critical value for 

a = 0.05 in the normal table (see 15.Tables in the Table of Contents). The 
z-score for an area to the left equal to 0.05 is midway between -1.65 and 
-1.64 (0.05 is midway between 0.0505 and 0.0495). The z-score is -1.645. 
Since —1.645 > —2.08 (which demonstrates that @ > p-value), reject Ho. 
Traditionally, the decision to reject or not reject was done in this way. 
Today, comparing the two probabilities a and the p-value is very common. 
For this problem, the p-value, 0.0187 is considerably smaller than a, 0.05. 
You can be confident about your decision to reject. The graph shows a, the 
p-value, and the test statistics and the critical value. 


— 


p-value = 0.0187 


-2.08 -1.645 0 


Example: 
Exercise: 


Problem: 


A college football coach thought that his players could bench press a 
mean weight of 275 pounds. It is known that the standard deviation 
is 55 pounds. Three of his players thought that the mean weight was 
more than that amount. They asked 30 of their teammates for their 
estimated maximum lift on the bench press exercise. The data ranged 
from 205 pounds to 385 pounds. The actual different weights were 
(frequencies are in parentheses) 205(3) 215(3) 225(1) 241(2) 252(2) 
265(2) 275(2) 313(2) 316(5) 338(2) 341(1) 345(2) 368(2) 385(1). 
(Source: data from Reuben Davis, Kraig Evans, and Scott 
Gunderson. ) 


Conduct a hypothesis test using a 2.5% level of significance to 
determine if the bench press mean is more than 275 pounds. 


Solution: 
Set up the Hypothesis Test: 


Since the problem is about a mean weight, this is a test of a single 
population mean. 


Hi — 2 J aT eT hS) This is a right-tailed test. 
Calculating the distribution needed: 


Random variable: X = the mean weight, in pounds, lifted by the 
football players. 


Distribution for the test: It is normal because o is known. 


z 55 
Kaen) (275, $5.) 


x = 286.2 pounds (from the data). 


o = 55 pounds (Always use o if you know it.) We assume fz = 275 
pounds unless our data shows us otherwise. 


Calculate the p-value using the normal distribution for a mean and 
using the sample mean as input (see the calculator instructions below 
for using the data as input): 


p-value = P( x > 286.2) = 0.1323. 


Interpretation of the p-value: If H, is true, then there is a 0.1331 
probability (13.23%) that the football players can lift a mean weight 
of 286.2 pounds or more. Because a 13.23% chance is large enough, a 
mean weight lift of 286.2 pounds or more is not a rare event. 


x= 286.2 p-value = 0.1323 
w= 275 


275 286.2 x 


Compare a and the p-value: 
w= 0025 p-value = 0.1323 
Make a decision: Since a<p-value, do not reject H,. 


Conclusion: At the 2.5% level of significance, from the sample data, 
there is not sufficient evidence to conclude that the true mean weight 
lifted is more than 275 pounds. 


The p-value can easily be calculated using the TI-83+ and the TI-84 
calculators: 


Put the data and frequencies into lists. Press STAT and arrow over to 
TESTS. Press 1:Z-Test. Arrow over to Data and press ENTER. 


Arrow down and enter 275 for 49, 55 for a, the name of the list where 
you put the data, and the name of the list where you put the 
frequencies. Arrow down to p : and arrow over to > [Up. Press 
ENTER. Arrow down to Calculate and press ENTER. The 
calculator not only calculates the p-value (p = 0.1331, a little 
different from the above calculation - in it we used the sample mean 
rounded to one decimal place instead of the data) but it also calculates 
the test statistic (z-score) for the sample mean, the sample mean, and 
the sample standard deviation. 4 > 275 is the alternate hypothesis. 
Do this set of instructions again except arrow to Dr aw (instead of 
Calculate). Press ENTER. A shaded graph appears with z = 1.112 
(test statistic) and p = 0.1331 (p-value). Make sure when you use 
Draw that no other equations are highlighted in Y = and the plots are 
turned off. 


Example: 
Exercise: 


Problem: 


Statistics students believe that the mean score on the first statistics test 
is 65. A statistics instructor thinks the mean score is higher than 65. 
He samples ten statistics students and obtains the scores 65 65 70 67 
66 63 63 68 72 71. He performs a hypothesis test using a 5% level of 
significance. The data are from a normal distribution. 


Solution: 
Set up the Hypothesis Test: 


A 5% level of significance means that a = 0.05. This is a test of a 
single population mean. 


Heo — op aie = 65 


Since the instructor thinks the average score is higher, use a ">". The 
">" means the test is right-tailed. 


Determine the distribution needed: 

Random variable: X = average score on the first statistics test. 
Distribution for the test: If you read the problem carefully, you will 
notice that there is no population standard deviation given. You are 
only given n = 10 sample data values. Notice also that the data come 
from a normal distribution. This means that the distribution for the 


test is a student's-t. 


Use tar. Therefore, the distribution for the test is tj) where n = 10 and 
df =10—-1=9. 


Calculate the p-value using the Student's-t distribution: 


p-value = P( x > 67 )= 0.0396 where the sample mean and sample 
standard deviation are calculated as 67 and 3.1972 from the data. 


Interpretation of the p-value: If the null hypothesis is true, then 


there is a 0.0396 probability (3.96%) that the sample mean is 67 or 
more. 


p-value = 0.0396 


65 67 * 


Compare q@ and the p-value: 


Since a = .05 and p-value = 0.0396. Therefore, a > p-value. 


Make a decision: Since a > p-value, reject Ho. 


This means you reject p42 = 65. In other words, you believe the 
average test score is more than 65. 


Conclusion: At a 5% level of significance, the sample data show 
sufficient evidence that the mean (average) test score is more than 65, 
just as the math instructor thinks. 


The p-value can easily be calculated using the TI-83+ and the TI-84 
calculators: 


Put the data into a list. Press STAT and arrow over to TESTS. Press 
2:T-Test. Arrow over to Data and press ENTER. Arrow down and 
enter 65 for jz, the name of the list where you put the data, and 1 for 
Freq:. Arrow down to p : and arrow over to > fo. Press ENTER. 
Arrow down to Calculate and press ENTER. The calculator not 
only calculates the p-value (p = 0.0396) but it also calculates the test 
Statistic (t-score) for the sample mean, the sample mean, and the 
sample standard deviation. jz > 65 is the alternate hypothesis. Do this 
set of instructions again except arrow to Dr aw (instead of 
Calculate). Press ENTER. A shaded graph appears with 

t = 1.9781 (test statistic) and p = 0.0396 (p-value). Make sure when 
you use Draw that no other equations are highlighted in Y = and the 
plots are turned off. 


Example: 
Exercise: 


Problem: 


Joon believes that 50% of first-time brides in the United States are 
younger than their grooms. She performs a hypothesis test to 
determine if the percentage is the same or different from 50%. Joon 
samples 100 first-time brides and 53 reply that they are younger than 
their grooms. For the hypothesis test, she uses a 1% level of 
significance. 


Solution: 
Set up the Hypothesis Test: 


The 1% level of significance means that a = 0.01. This is a test of a 
single population proportion. 


Hep ol) in ipra oe = 0p a9) 


The words "is the same or different from" tell you this is a two- 
tailed test. 


Calculate the distribution needed: 


Random variable: P/ = the percent of of first-time brides who are 
younger than their grooms. 


Distribution for the test: The problem contains no mention of a 


mean. The information is given in terms of percentages. Use the 
distribution for P/, the estimated proportion. 


Pi~N (», 4/ = Therefore, Pr ~ N (0, ae where 
p— 0: 50eg— bp 0 50 anda — 100; 
Calculate the p-value using the normal distribution for proportions: 


p-value = P(p’< 0.47 or p’ > 0.53 ) = 0.5485 


rae ee Se 
where £ = 53, pl= — = ito = 0.53. 


Interpretation of the p-value: If the null hypothesis is true, there is 
0.5485 probability (54.85%) that the sample (estimated) proportion p/ 
is 0.53 or more OR 0.47 or less (see the graph below). 


= (p-value) = 0.27425 = (p-value) = 0.27425 


0.47 0.50 0.53 


jt = p = 0.50 comes from A, the null hypothesis. 


pl= 0.53. Since the curve is symmetrical and the test is two-tailed, 
the p/ for the left tail is equal to 0.50 — 0.03 = 0.47 where 
pL = p = 0.50. (0.03 is the difference between 0.53 and 0.50.) 


Compare q@ and the p-value: 
Since a = 0.01 and p-value = 0.5485. Therefore, a< p-value. 
Make a decision: Since a<p-value, you cannot reject Ho. 


Conclusion: At the 1% level of significance, the sample data do not 
show sufficient evidence that the percentage of first-time brides that 
are younger than their grooms is different from 50%. 


The p-value can easily be calculated using the TI-83+ and the TI-84 
calculators: 


Press STAT and arrow over to TESTS. Press 5:1-PropZTest. 
Enter .5 for po, 53 for x and 100 for n. Arrow down to Prop and 
arrow tonot equals po. Press ENTER. Arrow down to 


Calculate and press ENTER. The calculator calculates the p-value 
(p = 0.5485) and the test statistic (z-score). Prop not equals .5 
is the alternate hypothesis. Do this set of instructions again except 
arrow to Draw (instead of Calculate). Press ENTER. A shaded 
graph appears with z = 0.6 (test statistic) and p = 0.5485 (p-value). 
Make sure when you use Dr aw that no other equations are 
highlighted in Y = and the plots are turned off. 


The Type I and Type IJ errors are as follows: 


The Type I error is to conclude that the proportion of first-time brides 
that are younger than their grooms is different from 50% when, in 
fact, the proportion is actually 50%. (Reject the null hypothesis when 
the null hypothesis is true). 


The Type II error is there is not enough evidence to conclude that the 
proportion of first time brides that are younger than their grooms 
differs from 50% when, in fact, the proportion does differ from 50%. 
(Do not reject the null hypothesis when the null hypothesis is false.) 


Example: 
Exercise: 


Problem: 


Suppose a consumer group suspects that the proportion of households 
that have three cell phones is 30%. A cell phone company has reason 
to believe that the proportion is 30%. Before they start a big 
advertising campaign, they conduct a hypothesis test. Their marketing 
people survey 150 households with the result that 43 of the 
households have three cell phones. 


Solution: 


Set up the Hypothesis Test: 


Hp ol) ipo) 
Determine the distribution needed: 


The random variable is P/ = proportion of households that have 
three cell phones. 


The distribution for the hypothesis test is P/ ~ N 
(0.30)-(0.70) 
(0.30, ee | 


Exercise: 


Problem: 
The value that helps determine the p-value is p/. Calculate p/. 


Solution: 


pl= = where zx is the number of successes and 7 is the 


total number in the sample. 


L—=—Ads =o) 
es 
P50) 
Exercise: 


Problem: What is a success for this problem? 


Solution: 


A success is having three cell phones in a household. 


Exercise: 


Problem: What is the level of significance? 


Solution: 


The level of significance is the preset a. Since a is not given, 
assume that a = 0.05. 


Draw the graph for this problem. Draw the horizontal axis. Label and 
shade appropriately. 
Exercise: 


Problem: Calculate the p-value. 


Solution: 


p-value = 0.7216 
Exercise: 


Problem: 


Make a decision. (Reject/Do not reject) Ho 
because 


Solution: 


Assuming that a = 0.05, a < p-value. The Decision is do not 
reject Ho because there is not sufficient evidence to conclude 
that the proportion of households that have three cell phones is 
not 30%. 


The next example is a poem written by a statistics student named Nicole 
Hart. The solution to the problem follows the poem. Notice that the 
hypothesis test is for a single population proportion. This means that the 
null and alternate hypotheses use the parameter p. The distribution for the 
test is normal. The estimated proportion p/ is the proportion of fleas killed 
to the total fleas found on Fido. This is sample information. The problem 
gives a preconceived a = 0.01, for comparison, and a 95% confidence 
interval computation. The poem is clever and humorous, so please enjoy it! 


Note:Hypothesis testing problems consist of multiple steps. To help you do 
the problems, solution sheets are provided for your use. Look in the Table 
of Contents Appendix for the topic "Solution Sheets." If you like, use 
copies of the appropriate solution sheet for homework problems. 


Example: 
Exercise: 


Problem: 


My dog has so many fleas, They do not come off 
with ease. As for shampoo, I have tried many 
types Even one called Bubble Hype, Which only 
killed 25% of the fleas, Unfortunately I was 
not pleased. I've used all kinds of soap, Until 
I had give up hope Until one day I saw An ad 
that put me in awe. A shampoo used for dogs 
Called GOOD ENOUGH to Clean a Hog Guaranteed to 
Kill more fleas. I gave Fido a bath And after 
doing the math His number of fleas Started 
dropping by 3's! Before his shampoo I counted 
42. At the end of his bath, I redid the math 
And the new shampoo had killed 17 fleas. So now 
I was pleased. Now it is time for you to have 
some fun With the level of significance being 
.01, You must help me figure out Use the new 
shampoo or go without? 


Solution: 
Set up the Hypothesis Test: 
Jali — Ue ep = 0.25 


Determine the distribution needed: 


In words, CLEARLY state what your random variable X or P’ 
represents. 


P’ = The proportion of fleas that are killed by the new shampoo 


State the distribution to use for the test. 
Normal: w (0.25, je ) 


Test Statistic: z = 2.3163 
Calculate the p-value using the normal distribution for proportions: 
p-value =0.0103 


In 1 — 2 complete sentences, explain what the p-value means for this 
problem. 


If the null hypothesis is true (the proportion is 0.25), then there is a 
0.0103 probability that the sample (estimated) proportion is 0.4048 
(+) or more. 


Use the previous information to sketch a picture of this situation. 
CLEARLY, label and scale the horizontal axis and shade the region(s) 
corresponding to the p-value. 


p' 
0.25 17/42= _ test statistic for 
0.4048 17/42: 2.3163 


Compare q@ and the p-value: 


Indicate the correct decision (“reject” or “do not reject” the null 
hypothesis), the reason for it, and write an appropriate conclusion, 


using COMPERTE SENTENCES: 


alpha decision reason for decision 


0.01 Do not reject H, a<p-value 


Conclusion: At the 1% level of significance, the sample data do not 
show sufficient evidence that the percentage of fleas that are killed by 
the new shampoo is more than 25%. 


Construct a 95% Confidence Interval for the true mean or proportion. 
Include a sketch of the graph of the situation. Label the point estimate 
and the lower and upper bounds of the Confidence Interval. 


p' 


0.26 17/42 0.55 


Confidence Interval: (0.26, 0.55) We are 95% confident that the true 
population proportion p of fleas that are killed by the new shampoo is 
between 26% and 55%. 


Note: This test result is not very definitive since the p-value is very 
close to alpha. In reality, one would probably do more tests by giving 
the dog another bath after the fleas have had a chance to return. 


Glossary 


Central Limit Theorem 
Given a random variable (RV) with known mean p and known 
standard deviation o. We are sampling with size n and we are 
interested in two new RVs - the sample mean, X, and the sample sum, 
3/X. If the size n of the sample is sufficiently large, then X ~ 


N(n, =) and XX ~ N(nu, no). If the size n of the sample is 


sufficiently large, then the distribution of the sample means and the 
distribution of the sample sums will approximate a normal distribution 
regardless of the shape of the population. The mean of the sample 
means will equal the population mean and the mean of the sample 
sums will equal n times the population mean. The standard deviation 
of the distribution of the sample means, Te is called the standard 


error of the mean. 


Standard Deviation 
A number that is equal to the square root of the variance and measures 
how far data values are from their mean. Notation: s for sample 
standard deviation and o for population standard deviation. 


Summary of Formulas 


A, and H, are contradictory. 


If greater than less than 
Hi, equal (=) or equal to or equal to 
has: (>) (S) 

then not equal (+) or greater 

H, than (>) or less than ec os are 
has: (<) 


If a < p-value, then do not reject Ho. 
If a > p-value, then reject H, . 


a is preconceived. Its value is set before the hypothesis test starts. The p- 
value is calculated from the data. 


a = probability of a Type I error = P(Type I error) = probability of rejecting 
the null hypothesis when the null hypothesis is true. 


@ = probability of a Type II error = P(Type II error) = probability of not 
rejecting the null hypothesis when the null hypothesis is false. 


If there is no given preconceived a, then use a = 0.05. 
Types of Hypothesis Tests 


e Single population mean, known population variance (or standard 
deviation): Normal test. 

e Single population mean, unknown population variance (or standard 
deviation): Student's-t test. 

e Single population proportion: Normal test. 


Practice 1: Single Mean, Known Population Standard Deviation 

This module provides a practice of Hypothesis Testing of Single Mean and 
Single Proportion as a part of Collaborative Statistics collection (col10522) 
by Barbara Illowsky and Susan Dean. 


Student Learning Outcomes 


e The student will conduct a hypothesis test of a single mean with 
known population standard deviation. 


Given 


Suppose that a recent article stated that the mean time spent in jail by a 
first-time convicted burglar is 2.5 years. A study was then done to see if the 
mean time has increased in the new century. A random sample of 26 first— 
time convicted burglars in a recent year was picked. The mean length of 
time in jail from the survey was 3 years with a standard deviation of 1.8 
years. Suppose that it is somehow known that the population standard 
deviation is 1.5. Conduct a hypothesis test to determine if the mean length 
of jail time has increased. The distribution of the population is normal. 


Hypothesis Testing: Single Mean 


Exercise: 


Problem: Is this a test of means or proportions? 
Solution: 


Means 


Exercise: 


Problem: State the null and alternative hypotheses. 


e aH: 


¢ b d.:: 


Solution: 


e a Hoi = 2.5 (or, Ho:p < 2.5) 
© by: > 2.5 


Exercise: 
Problem: 


Is this a right-tailed, left-tailed, or two-tailed test? How do you know? 


Solution: 
right-tailed 


Exercise: 


Problem: What symbol represents the Random Variable for this test? 


Solution: 
xX 


Exercise: 


Problem: In words, define the Random Variable for this test. 


Solution: 


The mean time spent in jail for 26 first time convicted burglars 
Exercise: 


Problem: 


Is the population standard deviation known and, if so, what is it? 


Solution: 
Yes, 1.5 
Exercise: 
Problem:Calculate the following: 
eaxrt=— 
e bo= 
ec Sx = 
e d t= 
Solution: 
e a3 
e b1.5 


e c1.8 
e d26 


Exercise: 


Problem: 


Since both o and s, are given, which should be used? In 1 -2 complete 
sentences, explain why. 


Solution: 


oO 


Exercise: 


Problem: State the distribution to use for the hypothesis test. 


Solution: 


7 ‘ASL 
X-N(2.5,15) 


Exercise: 
Problem: 
Sketch a graph of the situation. Label the horizontal axis. Mark the 


hypothesized mean and the sample mean x. Shade the area 
corresponding to the p-value. 


= 
x 


Exercise: 


Problem: Find the p-value. 
Solution: 
0.0446 
Exercise: 
Problem: At a pre-conceived a@ = 0.05, what is your: 


e a Decision: 
e b Reason for the decision: 
e c Conclusion (write out in a complete sentence): 


Solution: 


e aReject the null hypothesis 


Discussion Questions 


Exercise: 


Problem: 


Does it appear that the mean jail time spent for first time convicted 
burglars has increased? Why or why not? 


Practice 2: Single Mean, Unknown Population Standard Deviation 

This module provides a practice of Hypothesis Testing of Single Mean and 
Single Proportion as a part of Collaborative Statistics collection (col10522) 
by Barbara Illowsky and Susan Dean. 


Student Learning Outcomes 


e The student will conduct a hypothesis test of a single mean with 
unknown population standard deviation. 


Given 
A random survey of 75 death row inmates revealed that the mean length of 
time on death row is 17.4 years with a standard deviation of 6.3 years. 


Conduct a hypothesis test to determine if the population mean time on death 
row could likely be 15 years. 


Hypothesis Testing: Single Mean 


Exercise: 


Problem: Is this a test of means or proportions? 
Solution: 
averages 


Exercise: 


Problem: State the null and alternative hypotheses. 


e aZHu: 
e bdH,: 


Solution: 


© ao:yw=15 
© bA yw #15 


Exercise: 
Problem: 
Is this a right-tailed, left-tailed, or two-tailed test? How do you know? 
Solution: 
two-tailed 


Exercise: 


Problem: What symbol represents the Random Variable for this test? 
Solution: 
»¢ 


Exercise: 


Problem: In words, define the Random Variable for this test. 


Solution: 


the mean time spent on death row for the 75 inmates 
Exercise: 


Problem: 
Is the population standard deviation known and, if so, what is it? 
Solution: 


No 


Exercise: 


Problem: Calculate the following: 
eaxrt=— 
© b6.3 = 
e cn = 
Solution: 
e al74 


e bs 
e c/5 


Exercise: 
Problem: 
Which test should be used? In 1 -2 complete sentences, explain why. 
Solution: 
t —test 


Exercise: 


Problem: State the distribution to use for the hypothesis test. 
Solution: 


t74 
Exercise: 
Problem: 
Sketch a graph of the situation. Label the horizontal axis. Mark the 


hypothesized mean and the sample mean, zx. Shade the area 
corresponding to the p-value. 


ee 
x 
Exercise: 


Problem: Find the p-value. 


Solution: 
0.0015 
Exercise: 

Problem: At a pre-conceived a@ = 0.05, what is your: 
e a Decision: 
e b Reason for the decision: 
e c Conclusion (write out in a complete sentence): 

Solution: 


e aReject the null hypothesis 


Discussion Question 


Does it appear that the mean time on death row could be 15 years? Why or 
why not? 


Practice 3: Single Proportion 

This module provides a practice of Hypothesis Testing of Single Mean and 
Single Proportion as a part of Collaborative Statistics collection (col10522) 
by Barbara Illowsky and Susan Dean. 


Student Learning Outcomes 


e The student will conduct a hypothesis test of a single population 
proportion. 


Given 


The National Institute of Mental Health published an article stating that in 
any one-year period, approximately 9.5 percent of American adults suffer 
from depression or a depressive illness. 
(http://www.nimh.nih.gov/publicat/depression.cfm) Suppose that in a 
survey of 100 people in a certain town, seven of them suffered from 
depression or a depressive illness. Conduct a hypothesis test to determine if 
the true proportion of people in that town suffering from depression or a 
depressive illness is lower than the percent in the general adult American 
population. 


Hypothesis Testing: Single Proportion 


Exercise: 


Problem: Is this a test of means or proportions? 


Solution: 


Proportions 


Exercise: 


Problem: State the null and alternative hypotheses. 


e aH: 
e bd: 
Solution: 


© a Ho:p = 0.095 
© b Aa:p < 0.095 


Exercise: 
Problem: 
Is this a right-tailed, left-tailed, or two-tailed test? How do you know? 
Solution: 
left-tailed 


Exercise: 


Problem: What symbol represents the Random Variable for this test? 


Solution: 
Pr 


Exercise: 


Problem: In words, define the Random Variable for this test. 


Solution: 


the proportion of people in that town surveyed suffering from 
depression or a depressive illness 


Exercise: 


Problem:Calculate the following: 


eat=— 
e bn = 
e Cc p/= 


Solution: 
e a/ 


e b100 
e c0.07 


Exercise: 
Problem: 


Calculate o,,. Make sure to show how you set up the formula. 


Solution: 


0.0293 


Exercise: 


Problem: State the distribution to use for the hypothesis test. 


Solution: 


Normal 
Exercise: 
Problem: 
Sketch a graph of the situation. Label the horizontal axis. Mark the 


hypothesized mean and the sample proportion, p-hat. Shade the area 
corresponding to the p-value. 


P' 
Exercise: 


Problem: Find the p-value 
Solution: 
0.1969 
Exercise: 
Problem: At a pre-conceived a = 0.05, what is your: 


e a Decision: 
¢ b Reason for the decision: 
¢ c Conclusion (write out in a complete sentence): 


Solution: 


e aDo not reject the null hypothesis 


Discusion Question 


Exercise: 
Problem: 
Does it appear that the proportion of people in that town with 


depression or a depressive illness is lower than general adult American 
population? Why or why not? 


Hypothesis Test Homework Link (Collaborative Statistics; R. Bloom 
custom version) 


Link to homework questions in Homework Collection/Book for Hypothesis 
Test Chapter 9 of Collaborative Statistics for R. Bloom 


Chapter 9 Review Questions Link (Collaborative Statistics; R. Bloom 
custom version) 


Link to Review Questions in Homework Collection/Book for Hypothesis 
Test Chapter 9 of Collaborative Statistics for R. Bloom 


Chapter 9 Review Questions (_http://cnx.org/content/19025/latest/_) 


Hypothesis Testing: Two Population Means and Two Population 
Proportions 


Student Learning Outcomes 
By the end of this chapter, the student should be able to: 


e Classify hypothesis tests by type. 

e Conduct and interpret hypothesis tests for two population means, 
population standard deviations known. 

e Conduct and interpret hypothesis tests for two population means, 
population standard deviations unknown. 

e Conduct and interpret hypothesis tests for two population proportions. 

¢ Conduct and interpret hypothesis tests for matched or paired samples. 


Introduction 


Studies often compare two groups. For example, researchers are interested 
in the effect aspirin has in preventing heart attacks. Over the last few years, 
newspapers and magazines have reported about various aspirin studies 
involving two groups. Typically, one group is given aspirin and the other 
group is given a placebo. Then, the heart attack rate is studied over several 
years. 


There are other situations that deal with the comparison of two groups. For 
example, studies compare various diet and exercise programs. Politicians 
compare the proportion of individuals from different income brackets who 
might vote for them. Students are interested in whether SAT or GRE 
preparatory courses really help raise their scores. 


In the previous chapter, you learned to conduct hypothesis tests on single 
means and single proportions. You will expand upon that in this chapter. 
You will compare two means or two proportions to each other. The general 
procedure is still the same, just expanded. 


To compare two means or two proportions, you work with two groups. The 
groups are classified either as independent or matched pairs. 


Independent groups mean that the two samples taken are independent, that 
is, sample values selected from one population are not related in any way to 
sample values selected from the other population. Matched pairs consist of 
two samples that are dependent. The parameter tested using matched pairs 
is the population mean. The parameters tested using independent groups are 
either population means or population proportions. 


Note:This chapter relies on either a calculator or a computer to calculate 
the degrees of freedom, the test statistics, and p-values. TI-83+ and TI-84 
instructions are included as well as the test statistic formulas. When using 
the TI-83+/TI-84 calculators, we do not need to separate two population 
means, independent groups, population variances unknown into large and 
small sample sizes. However, most statistical computer software has the 
ability to differentiate these tests. 


This chapter deals with the following hypothesis tests: 
Independent groups (samples are independent) 


e Test of two population means. 
e Test of two population proportions. 


Matched or paired samples (samples are dependent) 


e Becomes a test of one population mean. 


Comparing Two Independent Population Means with Unknown Population 
Standard Deviations 

This module provides an overview of Comparing Two Independent 
Population Means with Unknown Population Standard Deviations as a part 
of Collaborative Statistics collection (col10522) by Barbara Illowsky and 
Susan Dean. 


1. The two independent samples are simple random samples from two 
distinct populations. 

2. Both populations are normally distributed with the population means 
and standard deviations unknown unless the sample sizes are greater 
than 30. In that case, the populations need not be normally distributed. 


Note:The test comparing two independent population means with 
unknown and possibly unequal population standard deviations is called the 
Aspin-Welch t-test. The degrees of freedom formula was developed by 
Aspin-Welch. 


The comparison of two population means is very common. A difference 
between the two samples depends on both the means and the standard 
deviations. Very different means can occur by chance if there is great 
variation among the individual samples. In order to account for the 
variation, we take the difference of the sample means, X, - X92 , and divide 
by the standard error (shown below) in order to standardize the difference. 
The result is a t-score test statistic (shown below). 


Because we do not know the population standard deviations, we estimate 
them using the two sample standard deviations from our independent 
samples. For the hypothesis test, we calculate the estimated standard 


deviation, or standard error, of the difference in sample means, Diced 


Equation: 
The standard error is: 


The test statistic (t-score) is calculated as follows: 


Equation: 
t-score 
(1 — £2) — (wa — be) 
($1)? 4 (S2)? 
ny ne 
where: 


e sj, and Sg, the sample standard deviations, are estimates of 7, and oo, 
respectively. 

¢ o, and o>» are the unknown population standard deviations. 

e¢ x, and £2 are the sample means. jz; and j/2 are the population means. 


The degrees of freedom (df) is a somewhat complicated calculation. 
However, a computer or calculator calculates it easily. The dfs are not 
always a whole number. The test statistic calculated above is approximated 
by the student's-t distribution with dfs as follows: 
Equation: 

Degrees of freedom 


When both sample sizes n1 and 2 are five or larger, the student's-t 
approximation is very good. Notice that the sample variances s;7 and s2” 
are not pooled. (If the question comes up, do not pool the variances.) 


Note: It is not necessary to compute this by hand. A calculator or computer 
easily computes it. 


Example: 

Independent groups 

The average amount of time boys and girls ages 7 through 11 spend 
playing sports each day is believed to be the same. An experiment is done, 
data is collected, resulting in the table below. Both populations have a 
normal distribution. 


Average Number of Sample 
Sample Hours Playing Sports Standard 
Size Per Day Deviation 
Girls 9 2 hours V0.75 
Boys 16 3.2 hours 1.00 
Exercise: 
Problem: 


Is there a difference in the mean amount of time boys and girls ages 7 
through 11 play sports each day? Test at the 5% level of significance. 


Solution: 


The population standard deviations are not known. Let g be the 
subscript for girls and 6 be the subscript for boys. Then, jz, is the 


population mean for girls and py is the population mean for boys. 
This is a test of two independent groups, two population means. 


Random variable: X, — X;, = difference in the sample mean amount 
of time girls and boys play sports each day. 


Fy: [bg = be Lg — Lp = 9 
Hq: bg F bb Mg — Hy #0 
The words "the same" tell you H, has an "=". Since there are no 


other words to indicate H,, then assume "is different." This is a two- 
tailed test. 


Distribution for the test: Use ta where df is calculated using the df 
formula for independent groups, two population means. Using a 


calculator, df is approximately 18.8462. Do not pool the variances. 


Calculate the p-value using a student's-t distribution: p-value = 
0.0054 


Graph: 


l l 
> (p-value) = 0.0028 5 (p-value) = 0.0028 


f= ie 

Seal 

SO Lg Oh — ee re 

Half the p-value is below -1.2 and half is above 1.2. 
Make a decision: Since a > p-value, reject H,. 

This means you reject 4, = fp. The means are different. 


Conclusion: At the 5% level of significance, the sample data show 
there is sufficient evidence to conclude that the mean number of hours 
that girls and boys aged 7 through 11 play sports per day is different 
(mean number of hours boys aged 7 through 11 play sports per day is 
greater than the mean number of hours played by girls OR the mean 
number of hours girls aged 7 through 11 play sports per day is greater 
than the mean number of hours played by boys). 


Note: TI-83+ and TI-84: Press 
STAT 

. Arrow over to 

TLESES 

and press 

4:2-SampTTest 

. Arrow over to Stats and press 
ENTER 


. Arrow down and enter 


2 


for the first sample mean, 


V0.75 

for Sx1, 

9 

for n1, 

Se 

for the second sample mean, 
1 

for Sx2, and 

16 

for n2. Arrow down to p11: and arrow to 
does not equal 

2. Press 

ENTER 

. Arrow down to Pooled: and 
No 

. Press 


ENTER 


. Arrow down to 
Calculate 


and press 


ENTER 


. The p-value is p = 0.0054, the dfs are approximately 18.8462, and 
the test statistic is -3.14. Do the procedure again but instead of 
Calculate do Draw. 


Example: 

A study is done by a community group in two neighboring colleges to 
determine which one graduates students with more math classes. College A 
samples 11 graduates. Their average is 4 math classes with a standard 
deviation of 1.5 math classes. College B samples 9 graduates. Their 
average is 3.5 math classes with a standard deviation of 1 math class. The 
community group believes that a student who graduates from college A 
has taken more math classes, on the average. Both populations have a 
normal distribution. Test at a 1% significance level. Answer the following 
questions. 

Exercise: 


Problem:Is this a test of two means or two proportions? 
Solution: 


two means 


Exercise: 


Problem: 


Are the populations standard deviations known or unknown? 


Solution: 


unknown 


Exercise: 


Problem: Which distribution do you use to perform the test? 


Solution: 


student's-t 


Exercise: 


Problem: What is the random variable? 
Solution: 
X4— XB 
Exercise: 
Problem: What are the null and alternate hypothesis? 
Solution: 


. Hy: aS bes 
° Ha: a> MB 


Exercise: 


Problem:Is this test right, left, or two tailed? 


Solution: 


right 


Exercise: 


Problem: What is the p-value? 


Solution: 


0.1928 


Exercise: 


Problem:Do you reject or not reject the null hypothesis? 


Solution: 


Do not reject. 


Conclusion: 

At the 1% level of significance, from the sample data, there is not 
sufficient evidence to conclude that a student who graduates from college 
A has taken more math classes, on the average, than a student who 
graduates from college B. 


Glossary 


Degrees of Freedom (df) 
The number of objects in a sample that are free to vary. 


Standard Deviation 
A number that is equal to the square root of the variance and measures 
how far data values are from their mean. Notation: s for sample 
standard deviation and o for population standard deviation. 


Variable (Random Variable) 
A characteristic of interest in a population being studied. Common 
notation for variables are upper case Latin letters X, Y, Z,...; common 
notation for a specific value from the domain (set of all possible values 
of a variable) are lower case Latin letters x, y, z,.... For example, if X 
is the number of children in a family, then x represents a specific 
integer 0, 1, 2, 3, .... Variables in statistics differ from variables in 
intermediate algebra in two following ways. 


e The domain of the random variable (RV) is not necessarily a 
numerical set; the domain may be expressed in words; for 
example, if X = hair color then the domain is {black, blond, gray, 
green, orange}. 

e We can tell what specific value x of the Random Variable X takes 
only after performing the experiment. 


Comparing Two Independent Population Means with Known Population 
Standard Deviations 

This module provides an overview of hypothesis testing in situations where 
there are both two independent population means and known population 
standard deviations in statistics. 


Even though this situation is not likely (knowing the population standard 
deviations is not likely), the following example illustrates hypothesis testing 
for independent means, known population standard deviations. The 
sampling distribution for the difference between the means is normal and 
both populations must be normal. The random variable is X; — X>. The 
normal distribution has the following format: 


Equation: 
Normal distribution 
Equation: 
The standard deviation is: 
2 2 
O71 02 
CC) 
Ny no 
Equation: 


Example: 


independent groups, population standard deviations known: The mean 
lasting time of 2 competing floor waxes is to be compared. Twenty floors 
are randomly assigned to test each wax. Both populations have a normal 
distribution. The following table is the result. 


Population 
Sample Mean Number of Standard 
Wax Months Floor Wax Last Deviation 
1 5 0.33 
2 2.9 0.36 
Exercise: 
Problem: 


Does the data indicate that wax 1 is more effective than wax 2? Test 
at a 5% level of significance. 


Solution: 


This is a test of two independent groups, two population means, 
population standard deviations known. 


Random Variable: X; — X> = difference in the mean number of 
months the competing floor waxes last. 


Hy : p44 S po 


je Ea Tees 


The words "is more effective" says that wax 1 lasts longer than 
wax 2, on the average. "Longer" is a //>// symbol and goes into Hg. 
Therefore, this is a right-tailed test. 


Distribution for the test: The population standard deviations are 
known so the distribution is normal. Using the formula above, the 
distribution is: 


Ge = VGN (0. ie Le) 
Since j4j < jsg then yz — fg < O and the mean for the normal 
distribution is 0. 


Calculate the p-value using the normal distribution: p-value = 
O99 


Graph: 
p-value = 0.1799 


X1-X2 


0 0.1 
From H.: wy —p2 < 0 


09 — 9 2) — Ol 


Compare a and the p-value: a = 0.05 and p-value = 0.1799. 
Therefore, @ < p-value. 


Make a decision: Since a < p-value, do not reject Ho. 


Conclusion: At the 5% level of significance, from the sample data, 
there is not sufficient evidence to conclude that the mean time wax 1 
lasts is longer (wax 1 is more effective) than the mean time wax 2 
lasts. 


Note: TI-83+ and TI-84: Press 
STAT 

. Arrow over to 

TESTS 

and press 
3:2-SampZTest 

. Arrow over to 

Stats 

and press 

ENTER 

. Arrow down and enter 
aoe 

for sigmal, 

. 36 

for sigma2, 


3 


for the first sample mean, 


20 


for the second sample mean, and 

20 

for n2. Arrow down to j1: and arrow to > p22. Press 
ENTER 

. Arrow down to 

Calculate 

and press 

ENTER 


. The p-value is p = 0.1799 and the test statistic is 0.9157. Do the 
procedure again but instead of 


Calculate 
do 


Draw 


Comparing Two Independent Population Proportions 


1. The two independent samples are simple random samples that are 
independent. 

2. The number of successes is at least five and the number of failures is at 
least five for each of the samples. 


Comparing two proportions, like comparing two means, is common. If two 
estimated proportions are different, it may be due to a difference in the 
populations or it may be due to chance. A hypothesis test can help 
determine if a difference in the estimated proportions (P’, — P'g) reflects a 


difference in the population proportions. 


The difference of two proportions follows an approximate normal 
distribution. Generally, the null hypothesis states that the two proportions 
are the same. That is, H, : p4 = pp. To conduct the test, we use a pooled 
proportion, pe. 
Equation: 

The pooled proportion is calculated as follows: 


LAtTXLB 
NA+nNB 


c — 


Equation: 
The distribution for the differences is: 


1 1 
Pra — Ptp-N 0, >: (1 =p.) (= ie =| 


Equation: 
The test statistic (z-score) is: 


_ (p!4 — ple) — (pa — ps) 


pe-(1-pe)- (2 +2) 


Example: 

Two population proportions 

Two types of medication for hives are being tested to determine if there is a 
difference in the proportions of adult patient reactions. Twenty out of a 
random sample of 200 adults given medication A still had hives 30 
minutes after taking the medication. Twelve out of another random 
sample of 200 adults given medication B still had hives 30 minutes after 
taking the medication. Test at a 1% level of significance. 


Determining the solution 


This is a test of 2 population proportions. 
Exercise: 


Problem: How do you know? 


Solution: 


The problem asks for a difference in proportions. 


Let A and B be the subscripts for medication A and 
medication B. Then py, and pz are the desired population 
proportions. 


Random Variable: 

P’, — P’p = difference in the proportions of adult patients 
who did not react after 30 minutes to medication A and 
medication B. 


Jel NW =o pA — pa =U 
Hy: pa # PB PA— pp #FO 
The words "is a difference" tell you the test is two-tailed. 


Distribution for the test: Since this is a test of two 
binomial population proportions, the distribution is normal: 


_ fates — 204127 ion 
Pe = nating = 2001200 — 9-08 1—pe= 0.92 


Therefore, 
P’4— Pp 0, \/ (0.08) - (0.92) - (so + say) 
P’ 4 — P’z follows an approximate normal distribution. 


Calculate the p-value using the normal distribution: p- 
value = 0.1404. 


Estimated proportion for group A: 
ee ee all 
PA 7a = 200 


Estimated proportion for group B: 
Se] | =a Se 


1 
1... a I 
5 eee = ee = (p-value) = 0.0702 


~0.04 0 0.04 A 
From Ho, pa - pgp = 9. 


Po Pos — Oe 0.06. — 004 


Half the p-value is below -0.04 and half is above 0.04. 


Compare a and the p-value: a = 0.01 and the 
p-value = 0.1404. a < p-value. 


Make a decision: Since a@ < p-value, do not reject H. 


Conclusion: At a 1% level of significance, from the sample 
data, there is not sufficient evidence to conclude that there is 
a difference in the proportions of adult patients who did not 

react after 30 minutes to medication A and medication B. 


Note: TI-83+ and TI-84: Press 
STAT 

. Arrow over to 

MEous 

and press 
6:2-PropZTest 

. Arrow down and enter 
20 

for xl, 

200 

for nl, 

aL. 

for x2, and 


200 


for n2. Arrow down to 
p1 

: and arrow to 

not equal p2 

. Press 

ENTER 

. Arrow down to 
Calculate 

and press 

ENTER 


. The p-value is p = 0.1404 and the test statistic is 1.47. 
Do the procedure again but instead of 


Calculate 
do 


Draw 


Matched or Paired Samples 
This module provides an overview of Hypothesis Testing: Matched or Paired Samples as a part of 
Collaborative Statistics collection (col10522) by Barbara Illowsky and Susan Dean. 


. Simple random sampling is used. 

. Sample sizes are often small. 

Two measurements (samples) are drawn from the same pair of individuals or objects. 

. Differences are calculated from the matched or paired samples. 

. The differences form the sample that is used for the hypothesis test. 

. The matched pairs have differences that either come from a population that is normal or the number of 
differences is sufficiently large so the distribution of the sample mean of differences is approximately 
normal. 


AunRWNER 


In a hypothesis test for matched or paired samples, subjects are matched in pairs and differences are calculated. 
The differences are the data. The population mean for the differences, jg, is then tested using a Student-t test 
for a single population mean with n — 1 degrees of freedom where n is the number of differences. 
Equation: 

The test statistic (t-score) is: 


Example: 

Matched or paired samples 

A study was conducted to investigate the effectiveness of hypnotism in reducing pain. Results for randomly 
selected subjects are shown in the table. The "before" value is matched to an "after" value and the differences 
are calculated. The differences have a normal distribution. 


Subject: A B C D E F G H 

Before 6.6 6.5 9.0 10.3 11.3 8.1 6.3 11.6 

After 6.8 2.4 7.4 8.5 8.1 6.1 3.4 2.0 
Exercise: 

Problem: 


Are the sensory measurements, on average, lower after hypnotism? Test at a 5% significance level. 


Solution: 


Corresponding "before" and "after" values form matched pairs. (Calculate "sfter" - "before"). 


After Data Before Data Difference 


6.8 6.6 0.2 
2.4 6.5 -4.1 
7.4 9 -1.6 
8.5 10.3 -1.8 
8.1 11.3 -3.2 
6.1 8.1 -2 

3.4 6.3 -2.9 
2 11.6 -9.6 


The data for the test are the differences: {0.2, -4.1, -1.6, -1.8, -3.2, -2, -2.9, -9.6} 


The sample mean and sample standard deviation of the differences are: Ga = sl} anal og = BOL 
Verify these values. 


Let jg be the population mean for the differences. We use the subscript d to denote "differences." 


Random Variable: X, = the mean difference of the sensory measurements 
Equation: 


Ay: pa > 9 
There is no improvement. (jg is the population mean of the differences.) 
Equation: 

Ay: pa< 0 


There is improvement. The score should be lower after hypnotism so the difference ought to be negative 
to indicate improvement. 


Distribution for the test: The distribution is a student-t with df = n — 1 = 8 — 1 = 7. Use tz. (Notice 
that the test is for a single population mean.) 


Calculate the p-value using the Student-t distribution: p-value = 0.0095 


Graph: 


p-value = 0.0095 


—3.13 0 
From H,, Hd 2 0 


X q is the random variable for the differences. 

The sample mean and sample standard deviation of the differences are: 

Ai) = =S)o1l3} 

$q= 2.91 

Compare a and the p-value: a = 0.05 and p-value = 0.0095. a > p-value. 

Make a decision: Since a > p-value, reject Ho. 

This means that q < O and there is improvement. 

Conclusion: At a 5% level of significance, from the sample data, there is sufficient evidence to conclude 


that the sensory measurements, on average, are lower after hypnotism. Hypnotism appears to be effective 
in reducing pain. 


Note:For the TI-83+ and TI-84 calculators, you can either calculate the differences ahead of time (after 
- before) and put the differences into a list or you can put the after data into a first list and the before 
data into a second list. Then go to a third list and arrow up to the name. Enter 1st list name - 2nd list 
name. The calculator will do the subtraction and you will have the differences in the third list. 


Note:TI-83+ and TI-84: Use your list of differences as the data. Press 


STAT 

and arrow over to 
TESTS 

. Press 
2:T-Test 

. Arrow over to 
Data 


and press 


ENTER 

. Arrow down and enter 

0 

for 49, the name of the list where you put the data, and 
1 

for Freq:. Arrow down to 

U 

: and arrow over to 

< 

[o. Press 

ENTER 

. Arrow down to 

Calculate 

and press 

ENTER 

. The p-value is 0.0094 and the test statistic is -3.04. Do these instructions again except arrow to 
Draw 

(instead of 

Calculate 

). Press 


ENTER 


Example: 

A college football coach was interested in whether the college's strength development class increased his 
players' maximum lift (in pounds) on the bench press exercise. He asked 4 of his players to participate in a 
study. The amount of weight they could each lift was recorded before they took the strength development 
class. After completing the class, the amount of weight they could each lift was again measured. The data are 
as follows: 


Weight (in pounds) Player 1 Player 2 Player 3 Player 4 
Amount of weighted lifted prior to the class 205 241 338 368 


Amount of weight lifted after the class 295 252 330 360 


The coach wants to know if the strength development class makes his players stronger, on average. 
Exercise: 


Problem: 

Record the differences data. Calculate the differences by subtracting the amount of weight lifted prior to 
the class from the weight lifted after completing the class. The data for the differences are: {90, 11, -8, 
-8}. The differences have a normal distribution. 

Using the differences data, calculate the sample mean and the sample standard deviation. 

iba = Pilg} Sq = 46.7 

Using the difference data, this becomes a test of a single (fill in the blank). 

Define the random variable: X , = mean difference in the maximum lift per player. 

The distribution for the hypothesis test is ¢3. 

Ay: wa <0 A, : pg > 0 

Graph: 


p-value = 0.2150 


21.3 


Calculate the p-value: The p-value is 0.2150 


Decision: If the level of significance is 5%, the decision is to not reject the null hypothesis because 
a < p-value. 


What is the conclusion? 
Solution: 


means; At a 5% level of significance, from the sample data, there is not sufficient evidence to conclude 
that the strength development class helped to make the players stronger, on average. 


Example: 


Seven eighth graders at Kennedy Middle School measured how far they could push the shot-put with their 
dominant (writing) hand and their weaker (non-writing) hand. They thought that they could push equal 
distances with either hand. The following data was collected. 


Distance 
(in feet) Student Student Student Student Student Student Student 
using 1 2 3 4 5 6 7 


Dominant 


rand 30 26 34 17 19 26 20 


Weaker 


rena 28 14 27 18 17 26 16 


Exercise: 


Problem: 


Conduct a hypothesis test to determine whether the mean difference in distances between the children's 
dominant versus weaker hands is significant. 


Note:use a t-test on the difference data. Assume the differences have a normal distribution. The random 
variable is the mean difference. 


Note:The test statistic is 2.18 and the p-value is 0.0716. 


What is your conclusion? 


Solution: 


Ao: fa equals 0; Hz: 4g does not equal 0; Do not reject the null; At a 5% significance level, from the 
sample data, there is not sufficient evidence to conclude that the mean difference in distances between the 
children's dominant versus weaker hands is significant (there is not sufficient evidence to show that the 
children could push the shot-put further with their dominant hand). Alpha and the p-value are close so the 
test is not strong. 


Summary of Types of Hypothesis Tests 
Two Population Means 


e Populations are independent and population standard deviations are 
unknown. 

e Populations are independent and population standard deviations are 
known (not likely). 


Matched or Paired Samples 


¢ Two samples are drawn from the same set of objects. 
e Samples are dependent. 


Two Population Proportions 


e Populations are independent. 


Practice 1: Hypothesis Testing for Two Proportions 

This module provides a practice of Two Population Means and Two 
Population Proportions as a part of Collaborative Statistics collection 
(col10522) by Barbara Illowsky and Susan Dean. 


Student Learning Outcomes 


e The student will conduct a hypothesis test of two proportions. 


Given 


In the recent Census, 3 percent of the U.S. population reported being two or 
more races. However, the percent varies tremendously from state to state. 
(Source: http://www.census.gov/prod/cen2010/briefs/c2010br-02.pdf) 
Suppose that two random surveys are conducted. In the first random survey, 
out of 1000 North Dakotans, only 9 people reported being of two or more 
races. In the second random survey, out of 500 Nevadans, 17 people 
reported being of two or more races. Conduct a hypothesis test to determine 
if the population percents are the same for the two states or if the percent 
for Nevada is statistically higher than for North Dakota. 


Hypothesis Testing: Two Proportions 


Exercise: 


Problem: Is this a test of means or proportions? 
Solution: 


Proportions 


Exercise: 


Problem: State the null and alternative hypotheses. 


® a Ho: 


e b Aa: 


Solution: 


4 Hfo:pN =pnpD 


" Ha:pn >PND 


Exercise: 


Problem: 

Is this a right-tailed, left-tailed, or two-tailed test? How do you know? 
Solution: 

right-tailed 


Exercise: 


Problem: What is the Random Variable of interest for this test? 


Exercise: 


Problem: In words, define the Random Variable for this test. 
Exercise: 


Problem: 


Which distribution (Normal or student's-t) would you use for this 
hypothesis test? 


Solution: 


Normal 


Exercise: 


Problem: 
Explain why you chose the distribution you did for the above question. 
Exercise: 


Problem: Calculate the test statistic. 


Solution: 


3.50 
Exercise: 


Problem: 


Sketch a graph of the situation. Mark the hypothesized difference and 
the sample difference. Shade the area corresponding to the p —value. 


Exercise: 


Problem: Find the p —value: 


Solution: 


0.0002 


Exercise: 


Problem: At a pre-conceived a = 0.05, what is your: 


e a Decision: 
¢ b Reason for the decision: 
¢ c Conclusion (write out in a complete sentence): 


Solution: 


e aReject the null hypothesis 


Discussion Question 


Exercise: 
Problem: 
Does it appear that the proportion of Nevadans who are two or more 


races is higher than the proportion of North Dakotans? Why or why 
not? 


Practice 2: Hypothesis Testing for Two Averages 

This module provides a practice of Hypothesis Testing: Two Population 
Means and Two Population Proportions: as a part of Collaborative Statistics 
collection (col10522) by Barbara Illowsky and Susan Dean. 


Student Learning Outcome 


e The student will conduct a hypothesis test of two means. 


Given 


The U.S. Center for Disease Control reports that the mean life expectancy 
for whites born in 1900 was 47.6 years and for nonwhites it was 33.0 years. 
(http://www.cdc.gov/nchs/data/dvs/nvsr53_06t12.pdf ) Suppose that you 
randomly survey death records for people born in 1900 in a certain county. 
Of the 124 whites, the mean life span was 45.3 years with a standard 
deviation of 12.7 years. Of the 82 nonwhites, the mean life span was 34.1 
years with a standard deviation of 15.6 years. Conduct a hypothesis test to 
see if the mean life spans in the county were the same for whites and 
nonwhites. 


Hypothesis Testing: Two Means 


Exercise: 


Problem: Is this a test of means or proportions? 


Solution: 
Means 
Exercise: 
Problem: State the null and alternative hypotheses. 


® a Ho: 


e b Aa: 


Solution: 


° a Ho:uyw = LNW 
° b A, :uw F UNw 


Exercise: 


Problem: 
Is this a right-tailed, left-tailed, or two-tailed test? How do you know? 
Solution: 
two-tailed 
Exercise: 
Problem: What is the Random Variable of interest for this test? 
Solution: 
Xw — Xxw 
Exercise: 


Problem: 
In words, define the Random Variable of interest for this test. 
Solution: 


The difference between the mean life spans of whites and nonwhites. 


Exercise: 


Problem: 


Which distribution (Normal or student's-t) would you use for this 
hypothesis test? 


Exercise: 


Problem: 

Explain why you chose the distribution you did for the above question. 
Exercise: 

Problem: Calculate the test statistic. 


Solution: 


5.42 
Exercise: 
Problem: 
Sketch a graph of the situation. Label the horizontal axis. Mark the 


hypothesized difference and the sample difference. Shade the area 
corresponding to the p —value. 


< > 


Exercise: 


Problem: Find the p —value: 


Solution: 


0.0000 
Exercise: 
Problem: At a pre-conceived a = 0.05, what is your: 


e a Decision: 
e b Reason for the decision: 
¢ c Conclusion (write out in a complete sentence): 


Solution: 


e aReject the null hypothesis 


Discussion Question 


Exercise: 


Problem: 


Does it appear that the means are the same? Why or why not? 


Hypothesis Test (2 means; paired samples; 2 proportions) Homework Link 
(Collaborative Statistics; R. Bloom custom version) 


Link to homework questions in Homework Collection/Book for Hypothesis 


Tests (2 means; paired samples; 2 proportions) Chapter 10 of Collaborative 
Statistics for R. Bloom 


Chapter 10 Review Questions Link (Collaborative Statistics; R. Bloom 
custom version) 


Link to Review Questions in Homework Collection/Book for Hypothesis 
Tests with Two Samples Chapter 10 of Collaborative Statistics for R. 
Bloom 


Chapter 10 Review Questions (_http://cnx.org/content/m19028/latest/ ) 


The Chi-Square Distribution 

This module provides an introduction to Chi-Square Distribution as a part 
of Collaborative Statistics collection (col10522) by Barbara Illowsky and 
Susan Dean. 


Student Learning Outcomes 
By the end of this chapter, the student should be able to: 


e Interpret the chi-square probability distribution as the sample size 
changes. 

e Conduct and interpret chi-square goodness-of-fit hypothesis tests. 

e Conduct and interpret chi-square test of independence hypothesis tests. 

e¢ Conduct and interpret chi-square homogeneity hypothesis tests. 

e Conduct and interpret chi-square single variance hypothesis tests. 


Introduction 


Have you ever wondered if lottery numbers were evenly distributed or if 
some numbers occurred with a greater frequency? How about if the types of 
movies people preferred were different across different age groups? What 
about if a coffee machine was dispensing approximately the same amount 
of coffee each time? You could answer these questions by conducting a 
hypothesis test. 


You will now study a new distribution, one that is used to determine the 
answers to the above examples. This distribution is called the Chi-square 
distribution. 


In this chapter, you will learn the three major applications of the Chi-square 
distribution: 


e The goodness-of-fit test, which determines if data fit a particular 
distribution, such as with the lottery example 

e The test of independence, which determines if events are independent, 
such as with the movie example 


e The test of a single variance, which tests variability, such as with the 
coffee example 


Note: Though the Chi-square calculations depend on calculators or 
computers for most of the calculations, there is a table available (see the 
Table of Contents 15. Tables). TI-83+ and TI-84 calculator instructions are 
included in the text. 


Optional Collaborative Classroom Activity 


Look in the sports section of a newspaper or on the Internet for some sports 
data (baseball averages, basketball scores, golf tournament scores, football 
odds, swimming times, etc.). Plot a histogram and a boxplot using your 
data. See if you can determine a probability distribution that your data fits. 
Have a discussion with the class about your choice. 


Notation 

This module provides an overview of Chi-Square Distribution Notation as a 
part of Collaborative Statistics collection (col10522) by Barbara Illowsky 
and Susan Dean. 


The notation for the chi-square distribution is: 
2 2 
ee i 


where df = degrees of freedom depend on how chi-square is being used. (If 
you want to practice calculating chi-square probabilities then use 

df = n — 1. The degrees of freedom for the three major uses are each 
calculated differently.) 


For the x? distribution, the population mean is jz = df and the population 
standard deviation is 0 = 2 - df. 


The random variable is shown as x” but may be any upper case letter. 


The random variable for a chi-square distribution with k degrees of freedom 
is the sum of k& independent, squared standard normal variables. 


x8 = (Za) + (Ze)? ++ (24)? 


Facts About the Chi-Square Distribution 


1. The curve is nonsymmetrical and skewed to the right. 
2. There is a different chi-square curve for each df. 


df = 2 df = 24 


3. The test statistic for any test is always greater than or equal to zero. 
4. When df > 90, the chi-square curve approximates the normal. For X 
~ X atid the mean, 2 = df = 1000 and the standard deviation, 


o = ¥2-1000 = 44.7. Therefore, X ~ N(1000, 44.7), 
approximately. 
5. The mean, p, is located just to the right of the peak. 


_/7 


vy 


In the next sections, you will learn about four different applications of the 
Chi-Square Distribution. These hypothesis tests are almost always right- 
tailed tests. In order to understand why the tests are mostly right-tailed, you 
will need to look carefully at the actual definition of the test statistic. Think 
about the following while you study the next four sections. If the expected 
and observed values are "far" apart, then the test statistic will be "large" and 
we will reject in the right tail. The only way to obtain a test statistic very 
close to zero, would be if the observed and expected values are very, very 
close to each other. A left-tailed test could be used to determine if the fit 
were "too good." A "too good" fit might occur if data had been manipulated 


or invented. Think about the implications of right-tailed versus left-tailed 
hypothesis tests as you learn the applications of the Chi-Square 
Distribution. 


Goodness-of-Fit Test 
This module describes how the chi-square distribution is used to conduct goodness-of-fit 
test. 


In this type of hypothesis test, you determine whether the data "fit" a particular 
distribution or not. For example, you may suspect your unknown data fit a binomial 
distribution. You use a chi-square test (meaning the distribution for the hypothesis test is 
chi-square) to determine if there is a fit or not. The null and the alternate hypotheses 
for this test may be written in sentences or may be stated as equations or 
inequalities. 


The test statistic for a goodness-of-fit test is: 
Equation: 


(0-5) 
KE 


where: 


e O = observed values (data) 
e F/= expected values (from theory) 
¢ k =the number of different data cells or categories 


The observed values are the data values and the expected values are the values you 
would expect to get if the null hypothesis were true. There are n terms of the form 
(O—E)’ 


7: 
The degrees of freedom are df = (number of categories - 1). 


The goodness-of-fit test is almost always right tailed. If the observed values and the 
corresponding expected values are not close to each other, then the test statistic can get 
very large and will be way out in the right tail of the chi-square curve. 


Note:The expected value for each cell needs to be at least 5 in order to use this test. 


Example: 

Absenteeism of college students from math classes is a major concern to math 
instructors because missing class appears to increase the drop rate. Suppose that a study 
was done to determine if the actual student absenteeism follows faculty perception. The 


faculty expected that a group of 100 students would miss class according to the 
following chart. 


Number absences per term Expected number of students 
0-2 50 

3-5 30 

6-8 f2 

9-11 6 

Dag 2 


A random survey across all mathematics courses was then done to determine the actual 
number (observed) of absences in a course. The next chart displays the result of that 
survey. 


Number absences per term Actual number of students 
0-2 35 

3-5 40 

6-8 20 

9-11 1 

1 2er 4 


Determine the null and alternate hypotheses needed to conduct a goodness-of-fit test. 
H,: Student absenteeism fits faculty perception. 


The alternate hypothesis is the opposite of the null hypothesis. 
H,: Student absenteeism does not fit faculty perception. 


Exercise: 


Problem: 


Can you use the information as it appears in the charts to conduct the goodness-of- 


fit test? 


Solution: 


No. Notice that the expected number of absences for the "12+" entry is less than 5 
(it is 2). Combine that group with the "9 - 11" group to create new tables where the 
number of students for each entry are at least 5. The new tables are below. 


Number absences per term 


Number absences per term 


Expected number of students 
50 
30 


12 


Actual number of students 
35 
40 


20 


Exercise: 


Problem: What are the degrees of freedom (df)? 
Solution: 


There are 4 "cells" or categories in each of the new tables. 


Gic— sin bet Oivce llc 10 —.4-- ale 95 


Example: 

Employers particularly want to know which days of the week employees are absent in a 
five day work week. Most employers would like to believe that employees are absent 
equally during the week. Suppose a random sample of 60 managers were asked on 
which day of the week did they have the highest number of employee absences. The 
results were distributed as follows: 


Monday Tuesday Wednesday Thursday Friday 
Number 


of 15 12 9 9 15 
Absences 


Day of the Week Employees were most Absent 


Exercise: 
Problem: 
For the population of employees, do the days for the highest number of absences 
occur with equal frequencies during a five day work week? Test at a 5% 
significance level. 


Solution: 


The null and alternate hypotheses are: 


¢ H,: The absent days occur with equal frequencies, that is, they fit a uniform 
distribution. 

e H,: The absent days occur with unequal frequencies, that is, they do not fit a 
uniform distribution. 


If the absent days occur with equal frequencies, then, out of 60 absent days (the 
total in the sample: 15 + 12 +9 +9 + 15 = 60), there would be 12 absences on 
Monday, 12 on Tuesday, 12 on Wednesday, 12 on Thursday, and 12 on Friday. 
These numbers are the expected (/) values. The values in the table are the 
observed (QO) values or data. 


This time, calculate the x? test statistic by hand. Make a chart with the following 
headings and fill in the columns: 


e Expected (£) values (12, 12, 12, 12, 12) 
e Observed (Q) values (15, 12, 9, 9, 15) 
(C=) 
° (O-E)’ 
(O-E)’ 
The last column (-—;-— ) should have 0.75, 0, 0.75, 0.75, 0.75. 


Now add (sum) the last column. Verify that the sum is 3. This is the x test 
statistic. 


To find the p-value, calculate P (x? = OP This test is right-tailed. 


(Use a computer or calculator to find the p-value. You should get 
p-value = 0.5578.) 


The disare the number of cells. — 1 — 5. I — 4) 


TI-83+ and TI-84: Press 2nd DISTR. Arrow down to x2cdf. Press ENTER. 
Enter (3, 10499, 4). Rounded to 4 decimal places, you should see 0.5578 which 
is the p-value. 


Next, complete a graph like the one below with the proper labeling and shading. 
(You should shade the right tail.) 


= ao 


x 


The decision is to not reject the null hypothesis. 
Conclusion: At a 5% level of significance, from the sample data, there is not 


sufficient evidence to conclude that the absent days do not occur with equal 
frequencies. 


Note:TI-83+ and some TI-84 calculators do not have a special program for the test 
Statistic for the goodness-of-fit test. The next example (Example 11-3) has the 
calculator instructions. The newer TI-84 calculators have in 


STAT TESTS 
the test 


Chi2 GOF 


. To run the test, put the observed values (the data) into a first list and the expected 
values (the values you expect if the null hypothesis is true) into a second list. Press 


STAT 
TESTS 

and 

Chi2 GOF 


. Enter the list names for the Observed list and the Expected list. Enter the degrees 
of freedom and press 


calculate 
or 
draw 


. Make sure you clear any lists before you start. See below. 


Note:To Clear Lists in the calculators: Go into 


STAT EDIT 


and arrow up to the list name area of the particular list. Press 


CLEAR 


and then arrow down. The list will be cleared. Or, you can press 


STAT 
and press 4 (for 


ClrList 


). Enter the list name and press 


ENTER 


Example: 


One study indicates that the number of televisions that American families have is 
distributed (this is the given distribution for the American population) as follows: 


Number of Televisions 


0 


over 3 


Percent 


10 


16 


55 


11 


The table contains expected (£) percents. 
A random sample of 600 families in the far western United States resulted in the 
following data: 


Number of Televisions Frequency 
0 66 
1 119 
2 340 
3 60 
over 3 bs 
Total = 600 


The table contains observed (O) frequency values. 
Exercise: 


Problem: 
At the 1% significance level, does it appear that the distribution "number of 


televisions" of far western United States families is different from the distribution 
for the American population as a whole? 


Solution: 
This problem asks you to test whether the far western United States families 
distribution fits the distribution of the American families. This test is always right- 


tailed. 


The first table contains expected percentages. To get expected (£) frequencies, 
multiply the percentage by 600. The expected frequencies are: 


Number of Televisions Percent Expected Frequency 


0 10 (0.10) - (600) = 60 
1 16 (0.16) - (600) = 96 
2 55 (0.55) - (600) = 330 
3 6 (0.11) - (600) = 66 
over 3 8 (0.08) - (600) = 48 


Therefore, the expected frequencies are 60, 96, 330, 66, and 48. In the TI 
calculators, you can let the calculator do the math. For example, instead of 60, enter 
.10*600. 


H,: The "number of televisions" distribution of far western United States families 
is the same as the "number of televisions" distribution of the American population. 


H,: The "number of televisions" distribution of far western United States families 
is different from the "number of televisions" distribution of the American 


population. 


Distribution for the test: x? where df = (the number of cells) —1 =5—1= 4. 


Note:df 4 600 — 1 


Calculate the test statistic: x? = 29.65 


Graph: 


p-value = 0.000006 (almost 0) 


Probability statement: p-value = P(x” > 29.65) = 0.000006. 


Compare a and the p-value: 


sa — 0 01 
e p-value = 0.000006 


So, a > p-value. 
Make a decision: Since a > p-value, reject Ho. 


This means you reject the belief that the distribution for the far western states is the 
same as that of the American population as a whole. 


Conclusion: At the 1% significance level, from the data, there is sufficient 
evidence to conclude that the "number of televisions" distribution for the far 
western United States is different from the "number of televisions" distribution for 
the American population as a whole. 


Note: TI-83+ and some TI-84 calculators: Press 
STAT 

and 

ENTER 

. Make sure to clear lists 


Li 


L2 

, and 

L3 

if they have data in them (see the note at the end of Example 11-2). Into 
L1 

, put the observed frequencies 


66 


, put the expected frequencies 


.10*600, .16*600 


’ 


.55*600 


’ 


.11*600 


.08*600 

. Arrow over to list 

L3 

and up to the name area 
mp gn 

. Enter 
(L1-L2)42/L2 

and 

ENTER 

. Press 

2nd QUIT 

. Press 

2nd LIST 

and arrow over to 
MATH 

. Press 

5 

. You should see 
"sum" (Enter L3) 
. Rounded to 2 decimal places, you should see 
29.65 

. Press 

2nd DISTR 


. Press 


7 
or Arrow down to 

fi X2COT. 

and press 

ENTER 

. Enter 

(29.65,1E99, 4) 

. Rounded to 4 places, you should see 

5.77E-6 = .000006 

(rounded to 6 decimal places) which is the p-value. 
The newer TI-84 calculators have in 

STAT TESTS 

the test 

Chi2 GOF 


. To run the test, put the observed values (the data) into a first list and the expected 
values (the values you expect if the null hypothesis is true) into a second list. Press 


STAT 
TESTS 

and 

Chi2 GOF 


. Enter the list names for the Observed list and the Expected list. Enter the degrees 
of freedom and press 


calculate 


or 


draw 


. Make sure you clear any lists before you start. 


Example: 
Exercise: 


Problem: 


Suppose you flip two coins 100 times. The results are 20 HH, 27 HT, 30 TH, and 
23 TT. Are the coins fair? Test at a 5% significance level. 


Solution: 


This problem can be set up as a goodness-of-fit problem. The sample space for 
flipping two fair coins is {HH, HT, TH, TT}. Out of 100 flips, you would expect 25 
HH, 25 HT, 25 TH, and 25 TT. This is the expected distribution. The question, "Are 
the coins fair?" is the same as saying, "Does the distribution of the coins (20 HH, 
27 HT, 30 TH, 23 TT) fit the expected distribution?" 


Random Variable: Let X = the number of heads in one flip of the two coins. X 
takes on the value 0, 1, 2. (There are 0, 1, or 2 heads in the flip of 2 coins.) 
Therefore, the number of cells is 3. Since X = the number of heads, the observed 
frequencies are 20 (for 2 heads), 57 (for 1 head), and 23 (for 0 heads or both tails). 
The expected frequencies are 25 (for 2 heads), 50 (for 1 head), and 25 (for 0 heads 
or both tails). This test is right-tailed. 


H,: The coins are fair. 

H,: The coins are not fair. 

Distribution for the test: y3 where df = 3 — 1 = 2. 
Calculate the test statistic: x? = 2.14 


Graph: 


p-value = 0.3430 


Probability statement: p-value = P (x? = 2.14) = 0.3430 


Compare a and the p-value: 


°° a=0.05 
¢ p-value = 0.3430 


So, a < p-value. 
Make a decision: Since a < p-value, do not reject Ho. 


Conclusion: There is insufficient evidence to conclude that the coins are not fair. 


Note: TI-83+ and some TI- 84 calculators: Press 
STAT 

and 

ENTER 

. Make sure you clear lists 


Li 


if they have data in them. Into 
L1 
, put the observed frequencies 


20 


, put the expected frequencies 


25 


. Arrow over to list 

L3 

and up to the name area 
mpg 

. Enter 
(L1-L2)A2/L2 

and 


ENTER 


. Press 

2nd QUIT 

. Press 

2nd LIST 

and arrow over to 
MATH 

. Press 

5 

. You should see 


"sum" 


Enter L3 

. Rounded to 2 decimal places, you should see 
2.14 

. Press 

2nd DISTR 

. Arrow down to 
7:x2cdf 

(or press 

7 

). Press 

ENTER 

. Enter 


2.14,1E99,2) 


. Rounded to 4 places, you should see 
. 3430 

which is the p-value. 

The newer TI-84 calculators have in 
STAT TESTS 

the test 

Chi2 GOF 


. To run the test, put the observed values (the data) into a first list and the expected 
values (the values you expect if the null hypothesis is true) into a second list. Press 


STAT 
TESTS 

and 

Chi2 GOF 


. Enter the list names for the Observed list and the Expected list. Enter the degrees 
of freedom and press 


calculate 
or 
draw 


. Make sure you clear any lists before you start. 


Test of Independence 
This module describes how the chi-square distribution can be used to test for independence. 


Tests of independence involve using a contingency table of observed (data) values. You first 
saw a contingency table when you studied probability in the Probability Topics chapter. 


The test statistic for a test of independence is similar to that of a goodness-of-fit test: 
Equation: 


(O— E)? 
(ij) £E 


where: 


¢ O= observed values 

e F = expected values 

e 2 =the number of rows in the table 

e 7 =the number of columns in the table 


There are z - 7 terms of the form oa, 


A test of independence determines whether two factors are independent or not. You first 
encountered the term independence in Chapter 3. As a review, consider the following 
example. 


Note:The expected value for each cell needs to be at least 5 in order to use this test. 


Example: 

Suppose A = a speeding violation in the last year and B = a cell phone user while driving. If 
A and B are independent then P(A AND B) = P(A)P(B). A AND Bis the event that a 
driver received a speeding violation last year and is also a cell phone user while driving. 
Suppose, in a study of drivers who received speeding violations in the last year and who uses 
cell phones while driving, that 755 people were surveyed. Out of the 755, 70 had a speeding 
violation and 685 did not; 305 were cell phone users while driving and 450 were not. 

Let y = expected number of drivers that use a cell phone while driving and received speeding 
violations. 


If A and B are independent, then P(A AND B) = P(A)P(B). By substitution, 
y _ 70 , 305 


755 755 | 75D 


Solve for y: y= BS = 28.3 


About 28 people from the sample are expected to be cell phone users while driving and to 
receive speeding violations. 


In a test of independence, we state the null and alternate hypotheses in words. Since the 
contingency table consists of two factors, the null hypothesis states that the factors are 
independent and the alternate hypothesis states that they are not independent (dependent). 
If we do a test of independence using the example above, then the null hypothesis is: 

H,: Being a cell phone user while driving and receiving a speeding violation are independent 
events. 

If the null hypothesis were true, we would expect about 28 people to be cell phone users 
while driving and to receive a speeding violation. 

The test of independence is always right-tailed because of the calculation of the test 
Statistic. If the expected and observed values are not close together, then the test statistic is 
very large and way out in the right tail of the chi-square curve, like goodness-of-fit. 

The degrees of freedom for the test of independence are: 

df = (number of columns - 1)(number of rows - 1) 


The following formula calculates the expected number (£): 
ee (row total)(column total) 
~ total number surveyed 


Example: 

In a volunteer group, adults 21 and older volunteer from one to nine hours each week to 
spend time with a disabled senior citizen. The program recruits among community college 
students, four-year college students, and nonstudents. The following table is a sample of the 
adult volunteers and the number of hours they volunteer per week. 


1-3 4-6 7-9 Row 
Type of Volunteer Hours Hours Hours Total 
Community College 1 96 48 955 
Students 
Four-Year College 96 133 61 290 
Students 
Nonstudents 91 150 53 294 
Column Total 298 379 162 839 


Number of Hours Worked Per Week by Volunteer Type (Observed)The table contains 
observed (O) values (data). 


Exercise: 


Problem: Are the number of hours volunteered independent of the type of volunteer? 
Solution: 


The observed table and the question at the end of the problem, "Are the number of 
hours volunteered independent of the type of volunteer?" tell you this is a test of 
independence. The two factors are number of hours volunteered and type of 
volunteer. This test is always right-tailed. 


H,: The number of hours volunteered is independent of the type of volunteer. 
H,: The number of hours volunteered is dependent on the type of volunteer. 


The expected table is: 


Type of Volunteer 1-3 Hours 4-6 Hours 7-9 Hours 
Community College Students 90.57 1509 49.24 
Four-Year College Students 103.00 131.00 56.00 
Nonstudents 104.42 132.81 56.77 


Number of Hours Worked Per Week by Volunteer Type (Expected)The table contains 
expected (/) values (data). 


For example, the calculation for the expected frequency for the top left cell is 


__ (row total)(column total) 255.298 __ 
i eimnbecimesede eae 


Calculate the test statistic: x” = 12.99 (calculator or computer) 
Distribution for the test: x3 
df = (3 columns — 1)(3 rows — 1) = (2)(2) =4 


Graph: 


p-value = 0.0113 


J+ 


0 12.99 


Probability statement: p-value = P(x” > 12.99) = 0.0113 


Compare a and the p-value: Since no a is given, assume a = 0.05. 
p-value = 0.0113. a > p-value. 


Make a decision: Since a > p-value, reject H,. This means that the factors are not 
independent. 


Conclusion: At a 5% level of significance, from the data, there is sufficient evidence to 
conclude that the number of hours volunteered and the type of volunteer are dependent 
on one another. 


For the above example, if there had been another type of volunteer, teenagers, what 
would the degrees of freedom be? 


Note:Calculator instructions follow. 


TI-83+ and TI-84 calculator: Press the MATRX key and arrow over to EDIT. Press 1: 
[A]. Press 3 ENTER 3 ENTER. Enter the table values by row from Example 11-6. 
Press ENTER after each. Press 2nd QUIT. Press STAT and arrow over to TESTS. 
Arrow down to C: x2-TEST. Press ENTER. You should see ObServed:[A] and 
Expected: [B]. Arrow down to Calculate. Press ENTER. The test statistic is 
12.9909 and the p-value = 0.0113. Do the procedure a second time but arrow down to 
Draw instead of calculate. 


Example: 

De Anza College is interested in the relationship between anxiety level and the need to 
succeed in school. A random sample of 400 students took a test that measured anxiety level 
and need to succeed in school. The table shows the results. De Anza College wants to know 
if anxiety level and need to succeed in school are independent events. 


Need to 


Succeed Med- Med- 

in High high Medium low Low Row 
School Anxiety Anxiety Anxiety Anxiety Anxiety Total 
“gH 35 42 53 15 10 155 
Need 

ee 48 63 33 a 193 
Need 

Low 

ikea 4 5 11 15 17 52 
CIP 95 127 63 58 400 
Total 


Need to Succeed in School vs. Anxiety Level 


Exercise: 


Problem: 


How many high anxiety level students are expected to have a high need to succeed in 
school? 


Solution: 


The column total for a high anxiety level is 57. The row total for high need to succeed 
in school is 155. The sample size or total surveyed is 400. 


__ (row total)(column total) 155-57 __ 
B= “totalsurveyed §§ 400 22.09 


The expected number of students who have a high anxiety level and a high need to 
succeed in school is about 22. 

Exercise: 
Problem: 


If the two variables are independent, how many students do you expect to have a low 
need to succeed in school and a med-low level of anxiety? 


Solution: 


The column total for a med-low anxiety level is 63. The row total for a low need to 
succeed in school is 52. The sample size or total surveyed is 400. 


Exercise: 


Problem: 


__ (row total)(column total) _ 
a ae total surveyed aa 


e b The expected number of students who have a med-low anxiety level and a 
low need to succeed in school is about: 


Solution: 


__ (row total)(column total) —__ 
Ce total surveyed = 8.19 
 b8 


Glossary 


Contingency Table 
The method of displaying a frequency distribution as a table with rows and columns to 
show how two variables may be dependent (contingent) upon each other. The table 
provides an easy way to calculate conditional probabilities. 


Test of a Single Variance (Optional) 

This module provides an overview on Chi-Square Distribution Tests of 
Variance as a part of Collaborative Statistics collection (col10522) by 
Barbara Illowsky and Susan Dean. 


A test of a single variance assumes that the underlying distribution is 
normal. The null and alternate hypotheses are stated in terms of the 
population variance (or population standard deviation). The test statistic 
is: 

Equation: 


(n —1)-s? 


o2 


where: 


e n= the total number of data 
e s” =sample variance 
eo = population variance 


You may think of s as the random variable in this test. The degrees of 
freedom are df = n — 1. 


A test of a single variance may be right-tailed, left-tailed, or two-tailed. 


The following example will show you how to set up the null and alternate 
hypotheses. The null and alternate hypotheses contain statements about the 
population variance. 


Example: 
Exercise: 


Problem: 


Math instructors are not only interested in how their students do on 
exams, on average, but how the exam scores vary. To many 
instructors, the variance (or standard deviation) may be more 
important than the average. 


Suppose a math instructor believes that the standard deviation for his 
final exam is 5 points. One of his best students thinks otherwise. The 
student claims that the standard deviation is more than 5 points. If the 
student were to conduct a hypothesis test, what would the null and 
alternate hypotheses be? 


Solution: 


Even though we are given the population standard deviation, we can 
set the test up using the population variance as follows. 


(ela or == ae 
¢ H,:07 > 5? 
Example: 
Exercise: 
Problem: 


With individual lines at its various windows, a post office finds that 
the standard deviation for normally distributed waiting times for 
customers on Friday afternoon is 7.2 minutes. The post office 
experiments with a single main waiting line and finds that for a 
random sample of 25 customers, the waiting times for customers have 
a standard deviation of 3.5 minutes. 


With a significance level of 5%, test the claim that a single line 
causes lower variation among waiting times (shorter waiting 


times) for customers. 
Solution: 


Since the claim is that a single line causes lower variation, this is a 
test of a single variance. The parameter is the population variance, 7, 
or the population standard deviation, o. 


Random Variable: The sample standard deviation, s, is the random 
variable. Let s = standard deviation for the waiting times. 


5 fle oe =e 
e Hi: o2<7.2" 


The word "lower" tells you this is a left-tailed test. 
Distribution for the test: eG 4» Where: 


e mn =the number of customers sampled 
«dfi—n—1=25 l= 24 


Calculate the test statistic: 


— 32 — cian 2 


wheres? = 25, s = 3.5,ando = /.2. 
Graph: 


p-value = 0.000042 


0 5.67 


Probability statement: p-value = lena =< 5.67) = 0.000042 


Compare qa and the p-value: 
a = 0.05 p-value = 0.000042 a > p-value 


Make a decision: Since a > p-value, reject Ho. 


This means that you reject o? = 7.27. In other words, you do not 
think the variation in waiting times is 7.2 minutes, but lower. 


Conclusion: At a 5% level of significance, from the data, there is 
sufficient evidence to conclude that a single line causes a lower 
variation among the waiting times or with a single line, the customer 
waiting times vary less than 7.2 minutes. 


TI-83+ and TI-84 calculators: In 2nd DISTR, use 7: x2cdf. The 
syntax is (lower, upper, df) for the parameter list. For 
Example 11-9, x2cdf (-1E99,5.67, 24). The 

p-value = 0.000042. 


Summary of Formulas 

This module provides a summary on formulas used in Chi-Square 
Distribution as a part of Collaborative Statistics collection (col10522) by 
Barbara Illowsky and Susan Dean. 


The Chi-Square Probability Distribution 
jojdi and: ¢ = /2-~- di 


Goodness-of-Fit Hypothesis Test 


e Use goodness-of-fit to test whether a data set fits a particular 
probability distribution. 


e The degrees of freedom are number of cells or categories - 1. 


oC» , where O = observed values (data), E = 


e The test statistic is 3 


expected values (from theory), and k = the number of different data 
cells or categories. 
e The test is right-tailed. 


Test of Independence 


e Use the test of independence to test whether two factors are 
independent or not. 

e The degrees of freedom are equal to 
(number of columns - 1)(number of rows - 1). 
_ 2 

e The test statistic is a so-ey where O = observed values, EF’ = 

uJ 

expected values, 2 = the number of rows in the table, and 7 = the 
number of columns in the table. 

e The test is right-tailed. 


e If the null hypothesis is true, the expected number 
ne (row total)(column total) 
~ ——— totalsurveyed 


Test of Homogeneity 


e Use the test for homogeneity to decide if two populations with 
unknown distributions have the same distribution as each other. 
e The degrees of freedom are equal to number of columns - 1. 


cosa —E) 
e The test statistic is »’ so-ey where O = observed values, F = 
ud 
expected values, 2 = the number of rows in the table, and 7 = the 
number of columns in the table. 
e The test is right-tailed. 


e If the null hypothesis is true, the expected number 
Be (row total) (column total) 
~— — totalsurveyed 


Note:The expected value for each cell needs to be at least 5 in order to use 
the Goodness-of-Fit, Independence and Homogeneity tests. 


Test of a Single Variance 


e Use the test to determine variation. 
e The degrees of freedom are the number of samples - 1. 


(n—1) -s? 


e The test statistic is 4 where n = the total number of data, s? = 


sample variance, and o” = population variance. 
e The test may be left, right, or two-tailed. 


Practice 1: Goodness-of-Fit Test 

This module provides a practice on Chi-Square Distribution as a part of 
Collaborative Statistics collection (col10522) by Barbara Illowsky and 
Susan Dean. 


Student Learning Outcomes 


e The student will conduct a goodness-of-fit test. 


Given 


The following data are real. The cumulative number of AIDS cases reported 
for Santa Clara County is broken down by ethnicity as follows: (Source: 
HIV/AIDS Epidemiology Santa Clara County, Santa Clara County Public 
Health Department, May 2011) 


Ethnicity Number of Cases 
White 2229 
Hispanic 1157 
Black/African-American 457 
Asian, Pacific Islander 232 

Total = 4075 


The percentage of each ethnic group in Santa Clara County is as follows: 


Ethnicity 
White 
Hispanic 


Black/African- 
American 


Asian, Pacific 
Islander 


Expected Results 


If the ethnicity of AIDS victims followed the ethnicity of the total county 


Percentage of total 
county population 


42.9% 


26.7% 


2.6% 


27.8% 


Total = 100% 


Number expected 
(round to 2 decimal 
places) 


1748.18 


population, fill in the expected number of cases per ethnic group. 


Goodness-of-Fit Test 


Perform a goodness-of-fit test to determine whether the make-up of AIDS 
cases follows the ethnicity of the general population of Santa Clara County. 


Exercise: 


Problem: H,: 


Exercise: 


Problem: H,: 


Exercise: 


Problem: Is this a right-tailed, left-tailed, or two-tailed test? 


Exercise: 


Problem: degrees of freedom = 


Solution: 


degrees of freedom = 3 


Exercise: 


Problem: Chi’ test statistic = 


Solution: 


2016.14 


Exercise: 


Problem: p-value = 


Solution: 


Rounded to 4 decimal places, the p-value is 0.0000. 
Exercise: 
Problem: 
Graph the situation. Label and scale the horizontal axis. Mark the 


mean and test statistic. Shade in the region corresponding to the p- 
value. 


Let a = 0.05 
Decision: 
Reason for the Decision: 


Conclusion (write out in complete sentences): 


Discussion Question 


Exercise: 
Problem: 
Does it appear that the pattern of AIDS cases in Santa Clara County 


corresponds to the distribution of ethnic groups in this county? Why or 
why not? 


Practice 2: Contingency Tables 
This module provides a practice on Chi-Square Distribution as a part of Collaborative Statistics 
collection (col10522) by Barbara Illowsky and Susan Dean. 


Student Learning Outcomes 
¢ The student will conduct a test for independence using contingency tables. 


Conduct a hypothesis test to determine if smoking level and ethnicity are independent. 


Collect the Data 


Copy the data provided in Probability Topics Practice 1: Contingency Tables into the table below. 


Smoking 

Level African Native Japanese 

Per Day American Hawaiian Latino Americans White TOTALS 
1-10 

11-20 

21-30 

31+ 

TOTALS 


Smoking Levels by Ethnicity (Observed) 


Hypothesis 
State the hypotheses. 


©. 1137 
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Expected Values 


Enter expected values in the above below. Round to two decimal places. 


Analyze the Data 


Calculate the following values: 


Exercise: 


Problem: Degrees of freedom = 


Solution: 
12 


Exercise: 


Problem: Chi’ test statistic = 


Solution: 
10301.8 
Exercise: 
Problem: p-value = 


Solution: 
0 


Exercise: 


Problem: Is this a right-tailed, left-tailed, or two-tailed test? Explain why. 


Solution: 


right 


Graph the Data 


Exercise: 


Problem: 


Graph the situation. Label and scale the horizontal axis. Mark the mean and test statistic. Shade in 
the region corresponding to the p-value. 


Conclusions 


State the decision and conclusion (in a complete sentence) for the following preconceived levels of a . 
Exercise: 


Problem: a = 0.05 
e a Decision: 
e b Reason for the decision: 
e c Conclusion (write out in a complete sentence): 


Solution: 


e aReject the null hypothesis 
Exercise: 


Problem: a = 0.01 


e a Decision: 
e b Reason for the decision: 
e c Conclusion (write out in a complete sentence): 


Practice 3: Test of a Single Variance 
This module provides a practice on Chi-Square Distribution as a part of 
Elementary Statistics textbook. 


Student Learning Outcomes 


e The student will conduct a test of a single variance. 


Given 


Suppose an airline claims that its flights are consistently on time with an 
average delay of at most 15 minutes. It claims that the average delay is so 
consistent that the variance is no more than 150 minutes. Doubting the 
consistency part of the claim, a disgruntled traveler calculates the delays for 
his next 25 flights. The average delay for those 25 flights is 22 minutes with 
a standard deviation of 15 minutes. 


Sample Variance 


Exercise: 


Problem: 


Is the traveler disputing the claim about the average or about the 
variance? 


Exercise: 


Problem: 


A sample standard deviation of 15 minutes is the same as a sample 
variance of minutes. 


Solution: 


220 


Exercise: 


Problem 


: Is this a right-tailed, left-tailed, or two-tailed test? 


Hypothesis Test 


Perform ah 
Exercise: 


Problem: 


Exercise: 


Problem: 


Exercise: 


Problem 


ypothesis test on the consistency part of the claim. 


Has 


ys 


: Degrees of freedom = 


Solution: 


24 


Exercise: 


Problem 


: Chi’ test statistic = 


Solution: 


36 


Exercise: 


Problem 


: p-value = 


Solution: 


0.0549 


Exercise: 


Problem: 


Graph the situation. Label and scale the horizontal axis. Mark the 
mean and test statistic. Shade the p-value. 


Exercise: 


Problem: Let a = 0.05 
Decision: 


Conclusion (write out in a complete sentence): 


Discussion Questions 


Exercise: 


Problem: How did you know to test the variance instead of the mean? 
Exercise: 

Problem: 

If an additional test were done on the claim of the average delay, which 

distribution would you use? 


Exercise: 


Problem: 


If an additional test was done on the claim of the average delay, but 45 
flights were surveyed, which distribution would you use? 


Chi Square Distribution Homework Link (Collaborative Statistics; R. 
Bloom custom version) 


Link to homework questions in Homework Collection/Book for Chi Square 
Distribution Chapter 11 of Collaborative Statistics for R. Bloom 


Chapter 11 Review Questions Link (Collaborative Statistics; R. Bloom 
custom version) 


Link to Review questions in Homework Collection/Book for Chi Square 
Distribution Chapter 11 of Collaborative Statistics for R. Bloom 


Linear Regression and Correlation 

This module provides an introduction of Linear Regression and Correlation 
as a part of Collaborative Statistics collection (col10522) by Barbara 
Illowsky and Susan Dean. 


Student Learning Outcomes 
By the end of this chapter, the student should be able to: 


e Discuss basic ideas of linear regression and correlation. 
e Create and interpret a line of best fit. 

e Calculate and interpret the correlation coefficient. 

e Calculate and interpret outliers. 


Introduction 


Professionals often want to know how two or more numeric variables are 
related. For example, is there a relationship between the grade on the 
second math exam a student takes and the grade on the final exam? If there 
is a relationship, what is it and how strong is the relationship? 


In another example, your income may be determined by your education, 
your profession, your years of experience, and your ability. The amount you 
pay a repair person for labor is often determined by an initial amount plus 
an hourly fee. These are all examples in which regression can be used. 


The type of data described in the examples is bivariate data - "bi" for two 
variables. In reality, statisticians use multivariate data, meaning many 
variables. 


In this chapter, you will be studying the simplest form of regression, "linear 

regression" with one independent variable (_). This involves data that fits a 

line in two dimensions. You will also study correlation which measures how 
strong the relationship is. 


Linear Regression and Correlation: Linear Equations 


Linear regression for two variables is based on a linear equation with one 
independent variable. It has the form: 
Equation: 


y=a+bx 


where a and b are constant numbers. 


x is the independent variable, and y is the dependent variable. 
Typically, you choose a value to substitute for the independent variable and 
then solve for the dependent variable. 


Example: 
The following examples are linear equations. 
Equation: 

v— 54 ok 
Equation: 


y = —0.01 + 1.2x 


The graph of a linear equation of the form y = a + bx is a straight line. 
Any line that is not vertical can be described by this equation. 


Example: 


15 


Graph of the equation y = —1 + 2x. 


Linear equations of this form occur in applications of life sciences, social 


sciences, psychology, business, economics, physical sciences, mathematics, 
and other areas. 


Example: 
Aaron's Word Processing Service (AWPS) does word processing. Its rate is 
$32 per hour plus a $31.50 one-time charge. The total cost to a customer 


depends on the number of hours it takes to do the word processing job. 
Exercise: 


Problem: 


Find the equation that expresses the total cost in terms of the number 
of hours required to finish the word processing job. 


Solution: 


Let x = the number of hours it takes to get the job done. 
Let y = the total cost to the customer. 


The $31.50 is a fixed cost. If it takes x hours to complete the job, then 
(32) (a) is the cost of the word processing only. The total cost is: 


y = 31.50 + 32x 


Linear Regression and Correlation: Slope and Y-Intercept of a Linear 
Equation 


For the linear equation y = a + bx, b= slope and a = y-intercept. 


From algebra recall that the slope is a number that describes the steepness 
of a line and the y-intercept is the y coordinate of the point (0, a) where the 
line crosses the y-axis. 


If b > O, the line If b = 0, the If b < OQ, the line slopes 
slopes upward to the line is downward to the right. 
right. horizontal. 


=| -—) FES 


Three possible graphs of y = a + bx. 


Example: 

Svetlana tutors to make extra money for college. For each tutoring session, 
she charges a one time fee of $25 plus $15 per hour of tutoring. A linear 
equation that expresses the total amount of money Svetlana earns for each 
session she tutors is y = 25 + 15x. 

Exercise: 


Problem: 
What are the independent and dependent variables? What is the y- 
intercept and what is the slope? Interpret them using complete 


sentences. 


Solution: 


The independent variable (x) is the number of hours Svetlana tutors 
each session. The dependent variable (y) is the amount, in dollars, 
Svetlana earns for each session. 


The y-intercept is 25 (a = 25). At the start of the tutoring session, 
Svetlana charges a one-time fee of $25 (this is when x = 0). The slope 
is 15 (b = 15). For each session, Svetlana earns $15 for each hour she 
tutors. 


Scatter Plots 

This module provides an overview of Linear Regression and Correlation: 
Scatter Plots as a part of Collaborative Statistics collection (col10522) by 
Barbara Illowsky and Susan Dean. 


Before we take up the discussion of linear regression and correlation, we 
need to examine a way to display the relation between two variables x and 
y. The most common and easiest way is a scatter plot. The following 
example illustrates a scatter plot. 


Example: 

From an article in the Wall Street Journal: In Europe and Asia, m- 
commerce is popular. M-commerce users have special mobile phones that 
work like electronic wallets as well as provide phone and Internet services. 
Users can do everything from paying for parking to buying a TV set or 
soda from a machine to banking to checking sports scores on the Internet. 
For the years 2000 through 2004, was there a relationship between the year 
and the number of m-commerce users? Construct a scatter plot. Let x = the 
year and let y = the number of m-commerce users, in millions. 


Table showing the number of Scatter plot showing the number 
m-commerce users (in of m-commerce users (in 
millions) by year. millions) by year. 

50 
g 
+ 
x (year) y (# of users) . 

0 

2000 0.5 2000 2002.~=—-2004 


x = year 


2002 20.0 


x (year) y (# of users) 
2003 Ba.0 


2004 47.0 


A scatter plot shows the direction and strength of a relationship between 
the variables. A clear direction happens when there is either: 


¢ High values of one variable occurring with high values of the other 
variable or low values of one variable occurring with low values of the 
other variable. 

e High values of one variable occurring with low values of the other 
variable. 


You can determine the strength of the relationship by looking at the scatter 
plot and seeing how close the points are to a line, a power function, an 
exponential function, or to some other type of function. 


When you look at a scatterplot, you want to notice the overall pattern and 
any deviations from the pattern. The following scatterplot examples 
illustrate these concepts. 

Positive Linear Pattern (Strong) 


Linear Pattern w/ One Deviation 


Exponential Growth Pattern 


o 
eo 
@e0ee ® 
No Pattern 
ee co) 
®e e 
e oO 
eo? fo} 


In this chapter, we are interested in scatter plots that show a linear pattern. 
Linear patterns are quite common. The linear relationship is strong if the 
points are close to a straight line. If we think that the points show a linear 
relationship, we would like to draw a line on the scatter plot. This line can 
be calculated through a process called linear regression. However, we only 
calculate a regression line if one of the variables helps to explain or predict 


the other variable. If x is the independent variable and y the dependent 
variable, then we can use a regression line to predict y for a given value of 
©; 


The Regression Equation (modified R. Bloom) 

This module provides an overview of Linear Regression and Correlation: 
The Regression Equation as a part of R. Bloom's custom Collaborative 
Statistics collection col10617. It has been modified from the original 
module m17090 in the Collaborative Statistics collection (col10522) by 
Barbara Illowsky and Susan Dean. This module now includes instructions 
for finding and graphing the regression equation and scatterplot using the 
LinRegTTest on the TI-83,83+,84+ calculators. 


Understanding the Regression Equation 


Data rarely fit a straight line exactly. Usually, you must be satisfied with 
rough predictions. Typically, you have a set of data whose scatter plot 
appears to "fit" a straight line. This is called a Line of Best Fit or Least 
Squares Line. 


Example: 

A random sample of 11 statistics students produced the following data 
where = is the third exam score, out of 80, and y is the final exam score, 
out of 200. Can you predict the final exam score of a random student if you 
know the third exam score? 


Table showing the scores on Scatter plot showing the scores 
the final exam based on scores on the final exam based on scores 
from the third exam. from the third exam. 
y (final 
x (third exam 


exam score) score) 


y (final ‘ = 
x (third exam eich ‘ of e 
exam score) score) g | a2 * 
ij 100 - 
65 is a 
60 65 70 75 80 

67 133 Third Exam Score 

FAN 185 

TAN 163 

66 126 

Us 198 

67 Jesy5) 

70 10}5) 

Ta. ioe) 

69 ideal! 

69 1S) 


The third exam score, x, is the independent variable and the final exam 
score, y, is the dependent variable. We will plot a regression line that best 
"fits" the data. If each of you were to fit a line "by eye", you would draw 
different lines. We can use what is called a least-squares regression line to 
obtain the best fit line. 


Consider the following diagram. Each point of data is of the the form (z, y) 
and each point of the line of best fit using least-squares linear regression has 
the form (z, 9). 


The y is read "y hat" and is the estimated value of y. It is the value of y 
obtained using the regression line. It is not generally equal to the observed y 
from data. 


data point = (x,, y,) 


distance = ly, - y. = 


64 69 74 


The term y — y is called the residual. It is the observed y value — the 
predicted ¥ value. It can also be called the "error". It is not an error in the 
sense of a mistake, but measures the vertical distance between the observed 
value y and the estimated value y. In other words, it measures the vertical 
distance between the actual data point and the predicted point on the line. 


If the observed data point lies above the line, the residual is positive, and 
the line underestimates the actual data value for y. In the observed data 
point lies below the line, the residual is negative, and the line overestimates 
that actual data value for y. 


In the Figure 2 diagram above, yo — Yo = €o is the residual for the point 
shown. Here the point lies above the line and the residual is positive. 


€ = the Greek letter epsilon 


For each data point, you can calculate the residuals or errors, y; — Y; = &; 
FOr LD. Oy cane lek, 


Each é¢ is a vertical distance. 


For the example about the third exam scores and the final exam scores for 
the 11 statistics students, there are 11 data points. Therefore, there are 11 € 
values. If you square each € and add, you get 


11 
(6) (a)rrn roe 


This is called the Sum of Squared Errors (SSE). 


Using calculus, you can determine the values of a and 6 that make the SSE 
a minimum. When you make the SSE a minimum, you have determined the 
points that are on the line of best fit. It turns out that the line of best fit has 
the equation: 


Equation: 
y=a+bx 
where a = y—6- x andb = See 


x and y are the averages of the x values and the y values, respectively. The 
best fit line always passes through the point (Zz, y). 


The slope 6 can be written as b = r- (=) where s, = the standard 


deviation of the y values and s, = the standard deviation of the x values. r 
is the correlation coefficient which is discussed in the next section. 


Least Squares Criteria for Best Fit 
The process of fitting the best fit line is called linear regression . The idea 
behind finding the best fit line is based on the assumption that the data are 


scattered about a straight line. The criteria for the best fit line is that the 
sum of the squared errors (SSE) is minimized, that is made as small as 
possible. Any other line you might choose would have a higher SSE than 
the best fit line. This best fit line is called the least squares regression line 


Note:Computer spreadsheets, statistical software, and many calculators 
can quickly calculate the best fit line and create the graphs. The 
calculations tend to be tedious if done by hand. Instructions to use the TI- 
83, TI-83+, and TI-84+ calculators to find the best fit line and create a 
scatterplot are shown at the end of this section. 


THIRD EXAM vs FINAL EXAM EXAMPLE: 
The graph of the line of best fit for the third exam/final exam example is 
shown below: 


250 - 
200 
[-) 
: 8 $ 
Mm 150 - 
= @ @ 
ke 100 - 
a 
= 50 
fe 
0 i 
64 69 74 
Third Exam Score 


The least squares regression line (best fit line) for the third exam/final exam 
example has the equation: 
Equation: 


j = —-173.51 + 4.83x 


Note: 


e Remember, it is always important to plot a scatter diagram first. If the 
scatter plot indicates that there is a linear relationship between the 
variables, then it is reasonable to use a best fit line to make 
predictions for y given x within the domain of z-values in the sample 
data, but not necessarily for z-values outside that domain. 

e You could use the line to predict the final exam score for a student 
who eared a grade of 73 on the third exam. 

e You should NOT use the line to predict the final exam score for a 
student who earned a grade of 50 on the third exam, because 50 is not 
within the domain of the x-values in the sample data, which are 
between 65 and 75. 


UNDERSTANDING SLOPE 

The slope of the line, b, describes how changes in the variables are related. 
It is important to interpret the slope of the line in the context of the situation 
represented by the data. You should be able to write a sentence interpreting 
the slope in plain English. 


INTERPRETATION OF THE SLOPE: The slope of the best fit line tells 
us how the dependent variable (y) changes for every one unit increase in the 
independent (x) variable, on average. 

THIRD EXAM vs FINAL EXAM EXAMPLE 


e Slope: The slope of the line is b = 4.83. 


e Interpretation: For a one point increase in the score on the third exam, 
the final exam score increases by 4.83 points, on average. 


Using the TI-83+ and TI-84+ Calculators 
Using the Linear Regression T Test: LinRegT Test 


In the STAT list editor, enter the X data in list L1 and the Y data in list L2, 
paired so that the corresponding (x,y) values are next to each other in the 
lists. (If a particular pair of values is repeated, enter it as many times as it 
appears in the data.) 

On the STAT TESTS menu, scroll down with the cursor to select the 
LinRegT Test. (Be careful to select LinRegTTest as some calculators may 
also have a different item called LinRegTInt.) 

On the LinRegTTest input screen enter: Xlist: L1 ; Ylist: L2 ; Freq: 1 

On the next line, at the prompt £ or p, highlight "4 0" and press ENTER 
Leave the line for "RegEq:" blank 

Highlight Calculate and press ENTER. 


LinRegTTest Input Screen and Output Screen 


LinRegT Test 
Xlist: L1 
Ylist: L2 
Freq: 1 


LinRegTTest 
y=at+bx 

£#0 and p#0 
t= 2.657560155 
p = .0261501512 
df=9 


B or p :[#0]<0 >0 
RegEQ: 
Calculate 


Ja = -173.513363 
b = 4.827394209 


s = 16.41237711 
r2= .4396931104 
r= 663093591 


TI-83+ and TI-84+ 
calculators 


The output screen contains a lot of information. For now we will focus on a 
few items from the output, and will return later to the other items. 


e The second line says y=at+bx. Scroll down to find the values 
a=-173.513, and b=4.8273 ; the equation of the best fit line is 
y = —173.51+ 4.832 

¢ The two items at the bottom are r? = .43969 and r=.663. For now, just 
note where to find these values; we will discuss them in the next two 
sections. 


Graphing the Scatterplot and Regression Line 


We are assuming your X data is already entered in list L1 and your Y data is 
in list L2 

Press 2nd STATPLOT ENTER to use Plot 1 

On the input screen for PLOT 1, highlightOnand press ENTER 

For TYPE: highlight the very first icon which is the scatterplot and press 
ENTER 

Indicate Xlist: L1 and Ylist: L2 

For Mark: it does not matter which symbol you highlight. 

Press the ZOOM key and then the number 9 (for menu item "ZoomStat") ; 
the calculator will fit the window to the data 

To graph the best fit line, press the "Y=" key and type the equation 
-173.5+4.83X into equation Y1. (The X key is immediately left of the STAT 
key). Press ZOOM 9 again to graph it. 

Optional: If you want to change the viewing window, press the WINDOW 
key. Enter your desired window using Xmin, Xmax, Ymin, Ymax 


Correlation Coefficient and Coefficient of Determination 

This module provides an overview of Linear Regression and Correlation: 
The Correlation Coefficient and Coefficient of Determination. It is part of 
the Roberta Bloom's Custom Collection of Collaborative Statistics 
(col10617). It is based on module m17092 as a part of Collaborative 
Statistics collection (col10522) by Barbara Illowsky and Susan Dean. This 
revised has been expanded from the original to include coverage of the 
coefficient of determination and to include a discussion of properties of the 
correlation coefficient previously included in Illowsky and Dean's module. 
Some material previously in module m17077 Facts about the Correlation 
Coefficient have been moved to this module in Bloom's custom edition of 
Collaborative Statistics. 


The Correlation Coefficient r 


Besides looking at the scatter plot and seeing that a line seems reasonable, 
how can you tell if the line is a good predictor? Use the correlation 
coefficient as another indicator (besides the scatterplot) of the strength of 
the relationship between x and y. 


The correlation coefficient, r, developed by Karl Pearson in the early 
1900s, is a numerical measure of the strength of association between the 
independent variable x and the dependent variable y. 


The correlation coefficient is calculated as r = dake ial CECE 
[n- Sx? (Xa)?]-[n-Ly?—(Ly)?] 


where n = the number of data points. 


If you suspect a linear relationship between z and y, then r can measure 
how strong the linear relationship is. 
What the VALUE of r tells us: 


e The value of r is always between -1 and +1: -1 <r <1. 

e The closer the correlation coefficient 7 is to -1 or 1 (and the further 
from 0), the stronger the evidence of a significant linear relationship 
between x and y; this would indicate that the observed data points fit 
more closely to the best fit line. Values of r further from 0 indicate a 


stronger linear relationship between z and y. Values of r closer to 0 
indicate a weaker linear relationship between z and y. 

e If r=0 there is absolutely no linear relationship between x and y (no 
linear correlation). 

e If r = 1, there is perfect positive correlation. If r = —1, there is 
perfect negative correlation. In both these cases, all of the original data 
points lie on a straight line. Of course, in the real world, this will not 
generally happen. 


What the SIGN of r tells us 


e A positive value of r means that when z increases, y increases and 
when z decreases, y decreases (positive correlation). 

e A negative value of r means that when z increases, y decreases and 
when «x decreases, y increases (negative correlation). 

e The sign of r is the same as the sign of the slope, b, of the best fit line. 


Note:Strong correlation does not suggest that 2 causes y or y causes 2. We 
say "correlation does not imply causation." For example, every person 
who learned math in the 17th century is dead. However, learning math does 
not necessarily cause death! 


Positive Correlation 


A scatter plot 
showing data 
with a 
positive 


correlation. 
O<r<l 


Negative Correlation 


A scatter plot 
showing data 
with a 
negative 
correlation. 
—-l<r<0 


Zero Correlation 


A scatter plot 
showing data 
with zero 
correlation. r 
=0 


The formula for r looks formidable. However, computer spreadsheets, 
statistical software, and many calculators can quickly calculate r. The 
correlation coefficient r is the bottom item in the output screens for the 


LinRegTTest on the TI-83, TI-83+, or TI-84+ calculator (see previous 
section for instructions). 


The Coefficient of Determination 


r? is called the coefficient of determination. r? is the square of the 


correlation coefficient , but is usually stated as a percent, rather than in 
decimal form. r? has an interpretation in the context of the data 


e r”, when expressed as a percent, represents the percent of variation in 
the dependent variable y that can be explained by variation in the 
independent variable x using the regression (best fit) line. 

e 1-r?, when expressed as a percent, represents the percent of variation 
in y that is NOT explained by variation in x using the regression line. 
This can be seen as the scattering of the observed data points about the 
regression line. 


Consider the third exam/final exam example introduced in the previous 
section 


e The line of best fit is: 7 = —173.51 + 4.83x 

¢ The correlation coefficient is r = 0.6631 

¢ The coefficient of determination is r? = 0.6631? = 0.4397 

¢ Interpretation of r? in the context of this example: 

e Approximately 44% of the variation in the final exam grades can be 
explained by the variation in the grades on the third exam, using the 
best fit regression line. 

e Therefore approximately 56% of the variation in the final exam grades 
can NOT be explained by the variation in the grades on the third exam, 
using the best fit regression line. (This is seen as the scattering of the 
points about the line.) 


In the next section, we will learn more about the correlation coefficient and 


will examine r in the context of the example about grades on the third exam 
and final exam. 


Glossary 


Coefficient of Correlation 
A measure developed by Karl Pearson (early 1900s) that gives the 
strength of association between the independent variable and the 
dependent variable. The formula is: 
Equation: 


ndxy- Ol #)QOly) 
Jind e? —(S 2)" nh Cv - Oly)? 
where n is the number of data points. The coefficient cannot be more 


then 1 and less then -1. The closer the coefficient is to +1, the stronger 
the evidence of a significant linear relationship between x and y. 


T= 


Testing the Significance of the Correlation Coefficient (modified R. Bloom) 
This module provides an overview of Testing the Significance of the 
Correlation Coefficient for Roberta Bloom's Custom Collection of 
Collaborative Statistics col10617. It has been modified from the original 
module m17077, Facts About the Correlation Coefficient for Linear 
Regression, which is part of Collaborative Statistics collection (col10522) 
by Barbara Illowsky and Susan Dean. The test of significance is presented 
as a hypothesis test both using the p-value and using a table of critical 
values. Some of the material from the original module m17077 has been 
moved to module m33269 in Bloom's custom collection of Collaborative 
Statistics. 


Testing the Significance of the Correlation Coefficient 


The correlation coefficient, r, tells us about the strength of the linear 
relationship between x and y. However, the reliability of the linear model 
also depends on how many observed data points are in the sample. We need 
to look at both the value of the correlation coefficient r and the sample size 
n, together. 


We perform a hypothesis test of the "significance of the correlation 
coefficient" to decide whether the linear relationship in the sample data is 
strong enough and reliable enough to use to model the relationship in the 
population. 


The sample data is used to compute r, the correlation coefficient for the 
sample. IF we had data for the entire population, we could find the 
population correlation coefficient. But because we only have sample data, 
we can not calculate the population correlation coefficient. The sample 
correlation coefficient, r, is our estimate of the unknown population 
correlation coefficient. 


¢ The symbol for the population correlation coefficient is p, the Greek 
letter "rho". 

¢ p = population correlation coefficient (unknown) 

e r=sample correlation coefficient (known; calculated from sample 
data) 


The hypothesis test lets us decide whether the value of the population 
correlation coefficient p is "close to 0" or "significantly different from 0". 
We decide this based on the sample correlation coefficient r and the sample 
size Nn. 

If the test concludes that the correlation coefficient is significantly 
different from 0, we say that the correlation coefficient is "significant". 


e Conclusion: "The correlation coefficient IS SIGNIFICANT" 

e What the conclusion means: We believe that there is a significant 
linear relationship between x and y. We can use the regression line to 
model the linear relationship between x and y in the population. 


If the test concludes that the correlation coefficient is not significantly 
different from 0 (it is close to 0), we say that correlation coefficient is 
"not significant". 


¢ Conclusion: "The correlation coefficient IS NOT SIGNIFICANT." 

e What the conclusion means: We do NOT believe that there is a 
significant linear relationship between x and y. Therefore we can NOT 
use the regression line to model a linear relationship between x and y 
in the population. 


Note: 


e If r is significant and the scatter plot shows a reasonable linear trend, 
the line can be used to predict the value of y for values of x that are 
within the domain of observed x values. 

e If ris not significant OR if the scatter plot does not show a reasonable 
linear trend, the line should not be used for prediction. 

e If r is significant and if the scatter plot shows a reasonable linear 
trend, the line may NOT be appropriate or reliable for prediction 
OUTSIDE the domain of observed x values in the data. 


PERFORMING THE HYPOTHESIS TEST 
SETTING UP THE HYPOTHESES: 


¢ Null Hypothesis: Ho: p=0 
e Alternate Hypothesis: Ha: p~0 


What the hypotheses mean in words: 


¢ Null Hypothesis Ho: The population correlation coefficient IS NOT 
significantly different from 0. There IS NOT a significant linear 
relationship(correlation) between x and y in the population. 

e Alternate Hypothesis Ha: The population correlation coefficient IS 
significantly DIFFERENT FROM O. There IS A SIGNIFICANT 
LINEAR RELATIONSHIP (correlation) between x and y in the 
population. 


DRAWING A CONCLUSION: 


e There are two methods to make the decision. Both methods are 
equivalent and give the same result. 

¢ Method 1: Using the p-value 

e Method 2: Using a table of critical values 

e In this chapter of this textbook, we will always use a significance level 
of 5%, « = 0.05 

e Note: Using the p-value method, you could choose any appropriate 
significance level you want; you are not limited to using a = 0.05. But 
the table of critical values provided in this textbook assumes that we 
are using a significance level of 5%, a = 0.05. (If we wanted to use a 
different significance level than 5% with the critical value method, we 
would need different tables of critical values that are not provided in 
this textbook.) 


METHOD 1: Using a p-value to make a decision 


e The linear regression t-test LinRegTTEST on the TI-83+ or TI-84+ 
calculators calculates the p-value. 

¢ On the LinRegTTEST input screen, on the line prompt for £ or p, 
highlight "¥ 0" 


e The output screen shows the p-value on the line that reads "p=". 
e (Most computer statistical software can calculate the p-value.) 


If the p-value is less than the significance level (a = 0.05): 


e Decision: REJECT the null hypothesis. 

¢ Conclusion: "The correlation coefficient IS SIGNIFICANT." 

e We believe that there IS a significant linear relationship between x and 
y. because the correlation coefficient is significantly different from 0. 


If the p-value is NOT less than the significance level (a = 0.05) 


e¢ Decision: DO NOT REJECT the null hypothesis. 

¢ Conclusion: "The correlation coefficient is NOT significant." 

e We believe that there is NOT a significant linear relationship between 
x and y. because the correlation coefficient is NOT significantly 
different from 0. 


Calculation Notes: 


e You will use technology to calculate the p-value. The following 
describe the calculations to compute the test statistics and the p-value: 

e The p-value is calculated using a ¢-distribution with n-2 degrees of 
freedom. 

rV/n—2 

V1—r? 
Statistic, ¢, is shown in the computer or calculator output along with 
the p-value. The test statistic ¢ has the same sign as the correlation 
coefficient r. 

e The p-value is the probability (area) in both tails further out beyond 
the values -¢ and ft. 

e For the TI-83+ and TI-84+ calculators, the command 
2*tcdf(abs(t),10499, n-2) computes the p-value given by the 
LinRegTTest; abs(t) denotes absolute value: |¢| 


. The value of the test 


e The formula for the test statistic is ¢ = 


THIRD EXAM vs FINAL EXAM EXAMPLE: p value method 


¢ Consider the third exam/final exam example. 


¢ The line of best fit is: ¥ = —173.51 + 4.83x with r = 0.6631 and 
there are n = 11 data points. 

e Can the regression line be used for prediction? Given a third exam 
score (x value), can we use the line to predict the final exam score 
(predicted y value)? 


e Ho: p=0 

e Ha: p #0 

e a=0.05 

e The p-value is 0.026 (from LinRegTTest on your calculator or from 
computer software) 

e The p-value, 0.026, is less than the significance level of a = 0.05 

¢ Decision: Reject the Null Hypothesis Ho 

¢ Conclusion: The correlation coefficient IS SIGNIFICANT. 

¢ Because 7 is significant and the scatter plot shows a reasonable 
linear trend, the regression line can be used to predict final exam 
scores. 


METHOD 2: Using a table of Critical Values to make a decision 

The 95% Critical Values of the Sample Correlation Coefficient Table at 
the end of this chapter (before the Summary) may be used to give youa 
good idea of whether the computed value of r is significant or not. 
Compare r to the appropriate critical value in the table. If r is not between 
the positive and negative critical values, then the correlation coefficient is 
significant. If r is significant, then you may want to use the line for 
prediction. 


Example: 

Suppose you computed r = 0.801 using n = 10 data points. 

df =n — 2 = 10 — 2 = 8. The critical values associated with df = 8 are 
-0.632 and + 0.632. If r< negative critical value or 

r > positive critical value, then r is significant. Since r = 0.801 and 
0.801 > 0.632, r is significant and the line may be used for prediction. If 
you view this example on a number line, it will help you. 


-| -0.632 0 +0. 632 +0. 801 +1 


r is not significant between -0.632 and +0.632. 
r = 0.801 > +0.632. Therefore, r is significant. 


Example: 

Suppose you computed r = —0.624 with 14 data points. 

df = 14 — 2 = 12. The critical values are -0.532 and 0.532. Since —0.624 
<—0.532, r is significant and the line may be used for prediction 


-0.6 624 -0.5 -0. 532 +0.532 


r = —0.624<—0.532. Therefore, r is significant. 


Example: 

Suppose you computed r = 0.776 and n = 6. df = 6 — 2 = 4. The 
critical values are -0.811 and 0.811. Since —0.811< 0.776 < 0.811, r is 
not significant and the line should not be used for prediction. 


-0.811 0.776 08 0811 


—0.811<r = 0.776<0.811. Therefore, 7 is not 
significant. 


THIRD EXAM vs FINAL EXAM EXAMPLE: critical value method 


¢ Consider the third exam/final exam example. 

e The line of best fit is: 7 = —173.51 + 4.83x with r = 0.6631 and 
there are n = 11 data points. 

e Can the regression line be used for prediction? Given a third exam 
score (x value), can we use the line to predict the final exam score 
(predicted y value)? 


Ho: p=0 

Ha: p #0 

a = 0.05 

Use the "95% Critical Value" table for r with 

df =n—2=11-2=9 

e The critical values are -0.602 and +0.602 

e Since 0.6631 > 0.602, r is significant. 

e Decision: Reject Ho 

¢ Conclusion: The correlation coefficient is significant 

¢ Because 7 is significant and the scatter plot shows a reasonable 
linear trend, the regression line can be used to predict final exam 
scores. 


Example: 

Additional Practice Examples using Critical Values 

Suppose you computed the following correlation coefficients. Using the 
table at the end of the chapter, determine if 7 is significant and the line of 
best fit associated with each r can be used to predict a y value. If it helps, 
draw a number line. 


1. r = —0.567 and the sample size, n, is 19. The df = n — 2 = 17. The 
critical value is -0.456. —0.567<—0.456 so r is significant. 

2. r = 0.708 and the sample size, n, is 9. The df = n — 2 = 7. The 
critical value is 0.666. 0.708 > 0.666 so r is significant. 

3. r = 0.134 and the sample size, n, is 14. The df = 14 — 2 = 12. The 
critical value is 0.532. 0.134 is between -0.532 and 0.532 so r is not 
significant. 


4.r = 0 and the sample size, n, is 5. No matter what the dfs are, r = O 
is between the two critical values so r is not significant. 


Assumptions in Testing the Significance of the Correlation 
Coefficient 


Testing the significance of the correlation coefficient requires that certain 
assumptions about the data are satisfied. The premise of this test is that the 
data are a sample of observed points taken from a larger population. We 
have not examined the entire population because it is not possible or 
feasible to do so. We are examining the sample to draw a conclusion about 
whether the linear relationship that we see between x and y in the sample 
data provides strong enough evidence so that we can conclude that there is a 
linear relationship between x and y in the population. 


The regression line equation that we calculate from the sample data gives 
the best fit line for our particular sample. We want to use this best fit line 
for the sample as an estimate of the best fit line for the population. 
Examining the scatterplot and testing the significance of the correlation 
coefficient helps us determine if it is appropriate to do this. 

The assumptions underlying the test of significance are: 


e There is a linear relationship in the population that models the average 
value of y for varying values of x. In other words, the average of the y 
values for each particular x value lie on a straight line in the 
population. (We do not know the equation for the line for the 
population. Our regression line from the sample is our best estimate of 
this line in the population.) 

e The y values for any particular x value are normally distributed about 
the line. This implies that there are more y values scattered closer to 
the line than are scattered farther away. Assumption (1) above implies 
that these normal distributions are centered on the line: the means of 
these normal distributions of y values lie on the line. 

e The standard deviations of the population y values about the line are 
the equal for each value of x. In other words, each of these normal 


distributions of y values has the same shape and spread about the line. 


The y values for each x value are normally distributed about the line 

with the same standard deviation. For each x value, the mean of the y 

values lies on the regression line. More y values lie near the line than 
are scattered further away from the line. 


Prediction (modified R. Bloom) 

This module provides an overview of Linear Regression and Correlation: 
Prediction as a part of R. Bloom's custom Collaborative Statistics collection 
(col10617). It has been modified from the original module m17092 in the 
Collaborative Statistics collection (col10522) by Barbara Illowsky and 
Susan Dean. 


Recall the third exam/final exam example. 


We examined the scatterplot and showed that the correlation coefficient is 
significant. We found the equation of the best fit line for the final exam 
grade as a function of the grade on the third exam. We can now use the least 
squares regression line for prediction. 


Suppose you want to estimate, or predict, the final exam score of statistics 
students who received 73 on the third exam. The exam scores (z-values) 
range from 65 to 75. Since 73 is between the z-values 65 and 75, 
substitute x = 73 into the equation. Then: 

Equation: 


y = —173.51+ 4.83 73 = 179.08 


We predict that statistic students who earn a grade of 73 on the third exam 
will earn a grade of 179.08 on the final exam, on average. 


Remember: Do not use the regression equation for prediction outside the 
domain of observed z values in the data. 


Example: 
Recall the third exam/final exam example. 
Exercise: 


Problem: 


What would you predict the final exam score to be for a student who 
scored a 66 on the third exam? 


Solution: 


145.27 
Exercise: 
Problem: 


What would you predict the final exam score to be for a student who 
scored a 78 on the third exam? 


Solution: 


The x values in the data are between 65 and 75. 78 is outside of the 
domain of the observed x values in the data (independent variables), 
so you cannot reliably predict the final exam score for this student. 
(Even though it is possible to enter x into the equation and calculate a 
y value, you should not do so!) 


Outliers (modified R. Bloom) 

This module provides an overview of Linear Regression and Correlation: 
Outliers as a part of the Collaborative Statistics Custom Collection 
modified by Roberta Bloom. it is based on the module m17094 in collection 
col10522 by Barbara Illowsky and Susan Dean. This module has been 
modified to include a graphical method of identifying outliers that was not 
included in the original module m17094. 


In some data sets, there are values (observed data points) called outliers. 
Outliers are observed data points that are far from the least squares 
line. They have large "errors", where the "error" or residual is the vertical 
distance from the line to the point. 


Outliers need to be examined closely. Sometimes, for some reason or 
another, they should not be included in the analysis of the data. It is possible 
that an outlier is a result of erroneous data. Other times, an outlier may hold 
valuable information about the population under study and should remain 
included in the data. The key is to carefully examine what causes a data 
point to be an outlier. 


Besides outliers, a sample may contain one or a few points that are called 
influential points. Influential points are observed data points that are far 
from the other observed data points but that greatly influence the line. As a 
result an influential point may be close to the line, even though it is far from 
the rest of the data. Because an influential point so strongly influences the 
best fit line, it generally will not have a large "error" or residual. 


Computers and many calculators can be used to identify outliers from the 
data. Computer output for regression analysis will often identify both 
outliers and influential points so that you can examine them. 


Identifying Outliers 

We could guess at outliers by looking at a graph of the scatterplot and best 
fit line. However we would like some guideline as to how far away a point 
needs to be in order to be considered an outlier. As a rough rule of thumb, 
we can flag any point that is located further than two standard 
deviations above or below the best fit line as an outlier. The standard 
deviation used is the standard deviation of the residuals or errors. 


We can do this visually in the scatterplot by drawing an extra pair of lines 
that are two standard deviations above and below the best fit line. Any data 
points that are outside this extra pair of lines are flagged as potential 
outliers. Or we can do this numerically by calculating each residual and 
comparing it to twice the standard deviation. On the TI-83, 83+, or 84+, the 
graphical approach is easier. The graphical procedure is shown first, 
followed by the numerical calculations. You would generally only need to 
use one of these methods. 


Example: 
Exercise: 


Problem: 


In the third exam/final exam example, you can determine if there is an 
outlier or not. If there is an outlier, as an exercise, delete it and fit the 
remaining data to a new line. For this example, the new line ought to 
fit the remaining data better. This means the SSE should be smaller 
and the correlation coefficient ought to be closer to 1 or -1. 


Solution: 


Graphical Identification of Outliers 

With the TI-83,83+,84+ graphing calculators, it is easy to identify the 
outlier graphically and visually. If we were to measure the vertical 
distance from any data point to the corresponding point on the line of 
best fit and that distance was equal to 2s or farther, then we would 
consider the data point to be "too far" from the line of best fit. We 
need to find and graph the lines that are two standard deviations 
below and above the regression line. Any points that are outside these 
two lines are outliers. We will call these lines Y2 and Y3: 


As we did with the equation of the regression line and the correlation 
coefficient, we will use technology to calculate this standard deviation 
for us. Using the LinRegT Test with this data, scroll down through the 
output screens to find s=16.412 


Line Y2=-173.5+4.83x-2(16.4) and line Y3=-173.5+4.83X+2(16.4) 


Graph the scatterplot with the best fit line in equation Y1, then enter 
the two extra lines as Y2 and Y3 in the "Y="equation editor and press 
ZOOM 9. You will find that the only data point that is not between 
lines Y2 and Y3 is the point x=65, y=175. On the calculator screen it 
is just barely outside these lines. The outlier is the student who had a 
grade of 65 on the third exam and 175 on the final exam; this point is 
further than 2 standard deviations away from the best fit line. 


Sometimes a point is so close to the lines used to flag outliers on the 
graph that it is difficult to tell if the point is between or outside the 
lines. On a computer, enlarging the graph may help; on a small 
calculator screen, Zooming in may make the graph more clear. Note 
that when the graph does not give a clear enough picture, you can use 
the numerical comparisons to identify outliers. 

[missing_resource: linrgoutlier.gif] 


Numerical Identification of Outliers 

In the table below, the first two columns are the third exam and final 
exam data. The third column shows the predicted ¥ values calculated 
from the line of best fit: y=-173.5+4.83x. The residuals, or errors, 
have been calculated in the fourth column of the table: 

observed y value — predicted y value = y — y. 


s is the standard deviation of all the y — y = e values where n = the 
total number of data points. If each residual is calculated and squared, 
and the results are added up, we get the SSE. The standard deviation 
of the residuals is calculated from the SSE as: 


— , f S15 
es n—2 


Rather than calculate the value of s ourselves, we can find s using the 
computer or calculator. For this example, our calculator LinRegTTest 
found s=16.4 as the standard deviation of the residuals: 35 -17 16 -6 
-1993-1-10-9-1. 


69 


Hesse, 


y 

140 
150 
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159 — 160 = —-1 


We are looking for all data points for which the residual is greater 
than 2s=2(16.4)=32.8 or less than -32.8. Compare these values to the 
residuals in column 4 of the table. The only such data point is the 
student who had a grade of 65 on the third exam and 175 on the final 
exam; the residual for this student is 35. 


How does the outlier affect the best fit line? 

Numerically and graphically, we have identified the point (65,175) as 
an outlier. We should re-examine the data for this point to see if there 
are any problems with the data. If there is an error we should fix the 
error if possible, or delete the data. If the data is correct, we would 
leave it in the data set. For this problem, we will suppose that we 


examined the data and found that this outlier data was an error. 
Therefore we will continue on to delete the outlier, so that we can 
explore how it affects the results, as a learning experience. 


Compute a new best-fit line and correlation coefficient using the 
10 remaining points: 

On the TI-83, TI-83+, TI-84+ calculators, delete the outlier from L1 
and L2. Using the LinRegTTest, the new line of best fit and the 
correlation coefficient are: 


y = —355.19 + 7.39x andr = 0.9121 


The new line with r = 0.9121 is a stronger correlation than the 
original (r=0.6631) because r = 0.9121 is closer to 1. This means 
that the new line is a better fit to the 10 remaining data values. The 
line can better predict the final exam score given the third exam score. 


Example: 
Exercise: 


Problem: 


Using this new line of best fit (based on the remaining 10 data points), 
what would a student who receives a 73 on the third exam expect to 
receive on the final exam? Is this the same as the prediction made 
using the original line? 


Solution: 


Using the new line of best fit 7 = —355.19 + 7.39(73) = 184.28. A 
student who scored 73 points on the third exam would expect to earn 
184 points on the final exam. 


The original line predicted ¥ = —173.51 + 4.83(73) = 179.08 so the 
prediction using the new line with the outlier eliminated differs from 
the original prediction. 


NOTE: 

Remember, we do not always delete an outlier. If upon examination, we 
determined this outlier to be a valid data point, we would leave it in the 
data. 


Example: 

(From The Consumer Price Indexes Web site) The Consumer Price Index 
(CPI) measures the average change over time in the prices paid by urban 
consumers for consumer goods and services. The CPI affects nearly all 
Americans because of the many ways it is used. One of its biggest uses is 
as a measure of inflation. By providing information about price changes in 
the Nation's economy to government, business, and labor, the CPI helps 
them to make economic decisions. The President, Congress, and the 
Federal Reserve Board use the CPI's trends to formulate monetary and 
fiscal policies. In the following table, x is the year and y is the CPI. 


x y 

1915 10.1 
1926 jeer e 
1935 Ser 
1940 14.7 
1947 24.1 


x y 
1964 31.0 
1969 36.7 
1975 49.3 
1979 726 
1980 82.4 
1986 109.6 
1991 130.7 
1999 166.6 

Data: 

Exercise: 

Problem: 


Make a scatterplot of the data. 

Calculate the least squares line. Write the equation in the form 
y=—a-+ bx. 

Draw the line on the scatterplot. 

Find the correlation coefficient. Is it significant? 

What is the average CPI for the year 1990? 

Are there any outliers in this data? 


Solution: 


Scatter plot and line of best fit. 
y = —3204 + 1.662x is the equation of the line of best fit. 
r = 0.8694 


e The number of data points is mn = 14. Use the 95% Critical 
Values of the Sample Correlation Coefficient table at the end of 
Chapter 12. n — 2 = 12. The corresponding critical value is 
0.532. Since 0.8694 > 0.532, r is significant. 

° y = —3204 + 1.662(1990) = 103.4 CPI 

e Using the calculator LinRegTTest, we find that s = 25.4 ; 
graphing the lines Y2=-3204+1.662X-2(25.4) and 
Y3=-3204+1.662X+2(25.4) shows that no data values are outside 
those lines, identifying no outliers. (Note that the year 1999 was 
very close to the upper line, but still inside it.) 
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Note: 

In example 3, notice the pattern of the points compared to the line. 
Although the correlation coefficient is significant, the pattern in the 
scatterplot indicates that a curve would be a more appropriate model to use 
than a line. In this example, a statistician should prefer to use other 
methods to fit a curve to this data, rather than model the data with the line 
we found. In addition to doing the calculations, it is always important to 
look at the scatterplot when deciding whether a linear model is appropriate. 
If you are interested in seeing more years of data for example 3, visit the 
Bureau of Labor Statistics CPI website 
ftp://ftp.bls.gov/pub/special.requests/cpi/cpiai.txt ; our data is taken from 
the column entitled "Annual Avg." (third column from the right). For 
example you could add more current years of data. Try adding the more 
recent years 2004 : CPI=188.9 and 2008 : CPI=215.3 and see how it affects 
the model. 


Glossary 


Outlier 
An observation that does not fit the rest of the data. 


Linear Regression and Correlation: Summary 
Bivariate Data: Each data point has two values. The form is 
Line of Best Fit or Least Squares Line (LSL): 

= independent variable; = dependent variable 


Residual: 
Correlation Coefficient r: 


1. Used to determine whether a line of best fit is good for prediction. 

2. Between -1 and 1 inclusive. The closer is to 1 or -1, the closer the 
original points are to a straight line. 

3.If is negative, the slope is negative. If is positive, the slope is 
positive. 

A. If , then the line is horizontal. 


Sum of Squared Errors (SSE): The smaller the SSE, the better the 
original set of points fits the line of best fit. 


Outlier: A point that does not seem to fit the rest of the data. 


95% Critical Values of the Sample Correlation Coefficient Table 

This module provides an overview of Linear Regression and Correlation: 
95% Critical Values of the Sample Correlation Coefficient Table as a part of 
Collaborative Statistics collection (col10522) by Barbara Illowsky and 
Susan Dean. 


Degrees of Freedom: Critical Values:( and _ ) 
ak 0.997 
2 0.950 
3 0.878 
4 0.811 
5 0.754 
6 0.707 
7 0.666 
8 0.632 
9 0.602 
10 0.576 
11 0.555 


12 0.532 


Degrees of Freedom: Critical Values:( and _ ) 


13 0.514 
14 0.497 
15 0.482 
16 0.468 
17 0.456 
18 0.444 
19 0.433 
20 0.423 
21 0.413 
22 0.404 
23 0.396 
24 0.388 
25 0.381 
26 0.374 
27 0.367 
28 0.361 


29 0.355 


Degrees of Freedom: Critical Values:( and) 


30 0.349 
40 0.304 
50 0.273 
60 0.250 
70 0.232 
80 0.217 
90 0.205 


100 0.195 


Practice: Linear Regression 

This module provides a practice of Linear Regression and Correlation as a 
part of Collaborative Statistics collection (col10522) by Barbara Illowsky 
and Susan Dean. 


Student Learning Outcomes 


e The student will evaluate bivariate data and determine if a line is an 
appropriate fit to the data. 


Given 


Below are real data for the first two decades of AIDS reporting. (Source: 
Centers for Disease Control and Prevention, National Center for HIV, STD, 
and TB Prevention) 


Year # AIDS cases diagnosed # AIDS deaths 
Pre-1981 91 29 

1981 319 121 

1982 1,170 453 

1983 3,076 1,482 

1984 6,240 3,466 

1985 11,776 6,878 


1986 19,032 11,987 


1987 28,564 16,162 


1988 35,447 20,868 
1989 42,674 2759 | 
1990 48,634 31,335 
1991 59,660 36,560 
1992 78,530 41,055 
1993 78,834 44,730 
1994 71,874 49,095 
1995 68,505 49,456 
1996 Do,047 38,510 
1997 47,149 20,736 
1998 38,393 19,005 
1999 25,174 18,454 
2000 20,02 2 17,347 
2001 25,643 17,402 
2002 26,464 16,371 
Total 802,118 489,093 


Adults and Adolescents only, United States 


Note:We will use the columns “year” and “# AIDS cases diagnosed” for 
all questions unless otherwise stated. 


Graphing 
Graph “year” vs. “# AIDS cases diagnosed.” Plot the points on the graph 


located below in the section titled "Plot" . Do not include pre-1981. 
Label both axes with words. Scale both axes. 


Data 


Exercise: 


Problem: 
Enter your data into your calculator or computer. The pre-1981 data 
should not be included. Why is that so? 

Linear Equation 


Write the linear equation below, rounding to 4 decimal places: 


Note:For any prediction questions, the answers are calculated using the 
least squares (best fit) line equation cited in the solution. 


Exercise: 


Problem: Calculate the following: 


eaa— 
a 


* @ Corr: = 
e dn =(# of pairs) 


Solution: 


© aa = -3,448,225 


¢e bb= 1750 

e ccorr. = 0.4526 

eal = 22 
Exercise: 


Problem: equation: 7 = 


Solution: 


y = -3,448,225 +1750x 


Solve 


Exercise: 


Problem: Solve. 


e a When x = 1985, y = 

¢ b When x = 1990, y = 
Solution: 

© a 25,525 


e b34,275 


Plot 


Plot the 2 above points on the graph below. Then, connect the 2 points to 
form the regression line. 


Obtain the graph on your calculator or computer. 


Discussion Questions 


Look at the graph above. 
Exercise: 


Problem: Does the line seem to fit the data? Why or why not? 


Exercise: 


Problem: Do you think a linear fit is best? Why or why not? 
Exercise: 

Problem: 

Hand draw a smooth curve on the graph above that shows the flow of 

the data. 


Exercise: 


Problem: 


What does the correlation imply about the relationship between time 
(years) and the number of diagnosed AIDS cases reported in the U.S.? 


Exercise: 


Problem: 


Why is “year” the independent variable and “# AIDS cases 
diagnosed.” the dependent variable (instead of the reverse)? 


Exercise: 
Problem: Solve. 
e aWhen x = 1970, 9 =: 
e bWhy doesn’t this answer make sense? 
Solution: 


e a-/25 


Homework Link 
Contains link to homework or review problems for R. Bloom custom 
collection of Collaborative Statistics by S. Dean and B. Illowsky 


Link to homework questions in Homework Collection/Book for Linear 
Regression Chapter 12 of Collaborative Statistics for R. Bloom 


F Distribution and ANOVA 

This module provides a brief introduction on handling hypothesis tests with 
two means by the one-way Analysis of Variance (One-Way ANOVA), F 
Distribution, and the Test of Two Variances statistical analysis. 


Student Learning Outcomes 
By the end of this chapter, the student should be able to: 


e Interpret the F probability distribution as the number of groups and the 
sample size change. 

e Discuss two uses for the F distribution: One-Way ANOVA and the test 
of two variances. 

e Conduct and interpret One-Way ANOVA. 

e Conduct and interpret hypothesis tests of two variances. 


Introduction 


Many statistical applications in psychology, social science, business 
administration, and the natural sciences involve several groups. For 
example, an environmentalist is interested in knowing if the average 
amount of pollution varies in several bodies of water. A sociologist is 
interested in knowing if the amount of income a person earns varies 
according to his or her upbringing. A consumer looking for a new car might 
compare the average gas mileage of several models. 


For hypothesis tests involving more than two averages, statisticians have 
developed a method called Analysis of Variance" (abbreviated ANOVA). In 
this chapter, you will study the simplest form of ANOVA called single 
factor or One-Way ANOVA. You will also study the F distribution, used for 
One-Way ANOVA, and the test of two variances. This is just a very brief 
overview of One-Way ANOVA. You will study this topic in much greater 
detail in future statistics courses. 


e One-Way ANOVA, as it is presented here, relies heavily on a 
calculator or computer. 


¢ For further information about One-Way ANOVA, use the online link 
ANOVA. Use the back button to return here. (The url is 
http://en.wikipedia.org/wiki/Analysis_of_variance.) 


ANOVA 
This module describes the assumptions needed for implementing an One- 
Way ANOVA and how to set up the hypothesis test for the ANOVA. 


F Distribution and One-Way ANOVA: Purpose and Basic 
Assumptions of One-Way ANOVA 


The purpose of a One-Way ANOVA test is to determine the existence of a 
statistically significant difference among several group means. The test 
actually uses variances to help determine if the means are equal or not. 


In order to perform a One-Way ANOVA test, there are five basic 
assumptions to be fulfilled: 


e Each population from which a sample is taken is assumed to be 
normal. 

e Each sample is randomly selected and independent. 

e The populations are assumed to have equal standard deviations (or 
variances). 

e The factor is the categorical variable. 

e The response is the numerical variable. 


The Null and Alternate Hypotheses 
The null hypothesis is simply that all the group population means are the 
same. The alternate hypothesis is that at least one pair of means is different. 


For example, if there are k groups: 


Hy: b1 = fe = bs =... = Mk 


HT, : At least two of the group means [11, [a, [43, ---, 4% are not equal. 


The graphs help in the understanding of the hypothesis test. In the first 
graph (red box plots), H, : 4j = 2 = pg and the three populations have 
the same distribution if the null hypothesis is true. The variance of the 
combined data is approximately the same as the variance of each of the 
populations. 


If the null hypothesis is false, then the variance of the combined data is 
larger which is caused by the different means as shown in the second graph 
(green box plots). 


Ho is true. All means are the same. 


Ho is false. All means are not the same. 


Glossary 


Analysis of Variance 
Also referred to as ANOVA. A method of testing whether or not the 
means of three or more populations are equal. The method is 
applicable if: 


e All populations of interest are normally distributed. 

e The populations have equal standard deviations. 

e Samples (not necessarily of the same size) are randomly and 
independently selected from each population. 


The test statistic for analysis of variance is the F-ratio. 


Variance 
Mean of the squared deviations from the mean. Square of the standard 
deviation. For a set of data, a deviation can be represented as x — x 
where z is a value of the data and z is the sample mean. The sample 
variance is equal to the sum of the squares of the deviations divided by 
the difference of the sample size and 1. 


The F Distribution and the F Ratio 
This module describes how to calculate the F Ratio and F Distribution based on the hypothesis 
test for the One-Way ANOVA. 


The distribution used for the hypothesis test is a new one. It is called the F distribution, named 
after Sir Ronald Fisher, an English statistician. The F' statistic is a ratio (a fraction). There are 
two sets of degrees of freedom; one for the numerator and one for the denominator. 


For example, if F' follows an F distribution and the degrees of freedom for the numerator are 4 
and the degrees of freedom for the denominator are 10, then F’~ F410. 


Note:The F distribution is derived from the Student's-t distribution. One-Way ANOVA expands 
the t-test for comparing more than two groups. The scope of that derivation is beyond the level 
of this course. 


To calculate the F' ratio, two estimates of the variance are made. 


1. Variance between samples: An estimate of o? that is the variance of the sample means 
multiplied by n (when there is equal n). If the samples are different sizes, the variance 
between samples is weighted to account for the different sample sizes. The variance is also 
called variation due to treatment or explained variation. 

2. Variance within samples: An estimate of o that is the average of the sample variances 
(also known as a pooled variance). When the sample sizes are different, the variance within 
samples is weighted. The variance is also called the variation due to error or unexplained 
variation. 


© SShetween = the sum of squares that represents the variation among the different samples. 
¢ SSwithin = the sum of squares that represents the variation within samples that is due to 
chance. 


To find a "sum of squares" means to add together squared quantities which, in some cases, may 
be weighted. We used sum of squares to calculate the sample variance and the sample standard 
deviation in Descriptive Statistics. 


MS means "mean square." MSpetween is the variance between groups and MS within is the 
variance within groups. 
Calculation of Sum of Squares and Mean Square 


e k =the number of different groups 

e 7, = the size of the jth group 

e s,;= the sum of the values in the jth group 

¢ n = total number of all the values combined. (total sample size: 5) n,;) 
° x=one value: ))z = )0s; 

e Sum of squares of all values from every group combined: * x? 


¢ Between group variability: SStotaa = >> x — fea) 2)" 


2 
¢ Total sum of squares: S> x2? — Quel 
e Explained variation- sum of squares representing variation among the different samples 


SSpetmeen = P(E] — Seer 


nj 
e Unexplained variation- sum of squares representing variation within samples due to chance: 
SS within > SStotal = SS between 
e df's for different groups (df's for the numerator): dfpetween = k — 1 
e Equation for errors within samples (df's for the denominator): df yithin = 2 — k 


e Mean square (variance estimate) explained by the different groups: MSpetween = Sevier, 
e Mean square (variance estimate) that is due to chance (unexplained): MS within = one 
within 


MS between and MS within Can be written as follows: 


SS etween pay SS etween 
© MStetween = Gr => 1 


dfpetween k— 
SSwithin SSwithin 
¢ MS within = caer = ar 


The One-Way ANOVA test depends on the fact that MSyetween Can be influenced by population 
differences among means of the several groups. Since MS,,;tnin Compares values of each group 
to its own group mean, the fact that group means might be different does not affect MS yitnin- 


The null hypothesis says that all groups are samples from populations having the same normal 
distribution. The alternate hypothesis says that at least two of the sample groups come from 
populations with different normal distributions. If the null hypothesis is true, MSpetween and 
MS within Should both estimate the same value. 


Note:The null hypothesis says that all the group population means are equal. The hypothesis of 
equal means implies that the populations have the same normal distribution because it is 
assumed that the populations are normal and that they have equal variances. 


Equation: 
F-Ratio or F Statistic 


MS between 


| ecm ea 
MS within 


If MSpetween and MS thin estimate the same value (following the belief that H,, is true), then the 
F-ratio should be approximately equal to 1. Mostly just sampling errors would contribute to 
variations away from 1. As it turns out, MSperween Consists of the population variance plus a 
variance produced from the differences between the samples. MS, itnin is an estimate of the 
population variance. Since variances are always positive, if the null hypothesis is false, 
MSpetween Will generally be larger than MS, ;+ni,. Then the F-ratio will be larger than 1. 


However, if the population effect size is small it is not unlikely that MS within will be larger in a 
give sample. 


The above calculations were done with groups of different sizes. If the groups are the same size, 
the calculations simplify somewhat and the F ratio can be written as: 


Equation: 
F-Ratio Formula when the groups are the same size 
2 
N+ 8x 
f= 2 
pooled 
where ... 


e n =the sample size 

° df numerator — k= 1 

° df denominator =) =k 

° So aia = the mean of the sample variances (pooled variance) 
° 5s,” = the variance of the sample means 


The data is typically put into a table for easy viewing. One-Way ANOVA results are often 
displayed in this manner by computer software. 


Degrees 
Sum of of 
Source of Squares Freedom Mean Square 
Variation (SS) (df) (MS) F 
MS(Factor) = es 
Factor F= 
(Between) Stacie) tea o Peconi: MS(Factor)/MS(Error) 
a MS(Error) = 
(Within) SS(Error) n-k aes (n- 
Total SS(Total) n-1 
Example: 


Three different diet plans are to be tested for mean weight loss. The entries in the table are the 
weight losses for the different plans. The One-Way ANOVA table is shown below. 


Plan 1 Plan 2 Plan 3 


5 cre 8 
4.5 I, 4 
A 3.5 
3 4.5 


One-Way ANOVA Table: The formulas for SS(Total), SS(Factor) = SS(Between) and SS(Error) 
= $S(Within) are shown above. This same information is provided by the TI calculator 
hypothesis test function ANOVA in STAT TESTS (syntax is ANOVA(L1, L2, L3) where L1, L2, 
L3 have the data from Plan 1, Plan 2, Plan 3 respectively). 


Degrees 
Sum of of 
Source of Squares Freedom Mean Square 
Variation (SS) (df) (MS) F 
k-1 MS(Factor) 
SS(Factor) =A = F= 
Factor = S(Factor)/(k- MS(Factor)/MS(Error) 
(Between)  SS(Between) ae ; 1) = 1,1229/2.9792 
=2.2458 ~9 = 2.2458/2 = 0.3769 
= 1.1229 
MS(Error) 
SS(Error) zs 2 = 
= = 10 total 
Error = Bree SS(Error)/(n- 
(Within) SS(Within) =rcnns ) 
= 20.8542 ae = 20.8542/7 
= 2.9792 
SS(Total) n-1 
Total = 2.9792 + = 10 total 
20.8542 data - 1 


=23.1 =o 


The One-Way ANOVA hypothesis test is always right-tailed because larger F-values are way 
out in the right tail of the F-distribution curve and tend to make us reject Ho. 


Notation 
The notation for the F distribution is F’ ~ Fa¢(num),df(denom) 


where df(num) = dfpetween and df(denom) = dfwithin 


df(num) 


The mean for the F distribution is u = aidenom) =. 


Facts About the F Distribution 

This module states the factors associated with F Distributions and provides 
students with some examples to help further understand the concept. 
Students will be given the opportunity to see F Distributions in action 
through participation in an optional classroom exercise. 


. The curve is not symmetrical but skewed to the right. 

. There is a different curve for each set of dfs. 

. The F statistic is greater than or equal to zero. 

. As the degrees of freedom for the numerator and for the denominator 
get larger, the curve approximates the normal. 

5. Other uses for the F distribution include comparing two variances and 

Two-Way Analysis of Variance. Comparing two variances is discussed 

at the end of the chapter. Two-Way Analysis is mentioned for your 

information only. 


BRWN RP 


Fi0,25 F409, 40 


Example: 
One-Way ANOVA: Four sororities took a random sample of sisters 
regarding their grade means for the past term. The results are shown below: 


MEAN GRADES FOR FOUR SORORITIES 


SOFdXNyGRADES SORROUR SORQRIHES Sorority 4 
Sorority 1 Sorority 2 Sorority 3 Sorority 4 
27, 2.63 2.63 3.79 

1.85 AZ 3.78 3.45 

2.83 3.25 4.00 3.08 

1.69 1.86 2.55 2.26 

3.33 Zo 2.45 3.18 

Exercise: 
Problem: 


Using a significance level of 1%, is there a difference in mean grades 
among the sororities? 


Solution: 


Let [41, 42, {3, [44 be the population means of the sororities. 
Remember that the null hypothesis claims that the sorority groups are 
from the same normal distribution. The alternate hypothesis says that 
at least two of the sorority groups come from populations with 
different normal distributions. Notice that the four sample sizes are 
each size 5. 


Note:This is an example of a balanced design, since each factor (i.e. 
Sorority) has the same number of observations. 


Ag: fy = M2 = b3 = ba 

Hf,: Not all of the means 44, fo, [43, 44 are equal. 
Distribution for the test: F’3 1¢ 

where k = 4 groups and n = 20 samples in total 
df(num) = k-—1=4-1=3 

df(denom) = n—k = 20-—4=16 

Calculate the test statistic: F’' = 2.23 


Graph: 


p-value = 0.1241 


0 2.23 


Probability statement: p-value = P(F > 2.23) = 0.1241 


Compare a and the p-value: 
a = 0.01 p-value = 0.1241 a < p-value 


Make a decision: Since a < p-value, you cannot reject Ho. 


Conclusion: There is not sufficient evidence to conclude that there is a 
difference among the mean grades for the sororities. 


TI-83+ or TI 84: Put the data into lists L1, L2, L3, and L4. Press 
STAT and arrow over to TESTS. Arrow down to F: ANOVA. Press 
ENTER and Enter (L1, L2, L3, L4). The F statistic is 2.2303 and the 


p-value is 0.1241. df(numerator) = 3 (under "Factor") and 
df(denominator) = 16 (under Error). 


Example: 


A fourth grade class is studying the environment. One of the assignments is 
to grow bean plants in different soils. Tommy chose to grow his bean plants 
in soil found outside his classroom mixed with dryer lint. Tara chose to 
grow her bean plants in potting soil bought at the local nursery. Nick chose 
to grow his bean plants in soil from his mother's garden. No chemicals were 
used on the plants, only water. They were grown inside the classroom next 
to a large window. Each child grew 5 plants. At the end of the growing 
period, each plant was measured, producing the following data (in inches): 


Tommy's Plants 
24 
21 
a3 
30 


23 


Exercise: 


Tara's Plants 


US) 


31 


23 


20 


28 


Nick's Plants 


Zo 


27 


Ze 


30 


20 


Problem: 


Does it appear that the three media in which the bean plants were 
grown produce the same mean height? Test at a 3% level of 
significance. 


Solution: 


This time, we will perform the calculations that lead to the F' statistic. 
Notice that each group has the same number of plants so we will use 


ie 
the formula F’ = “2 


5” pooled ; 


First, calculate the sample mean and sample variance of each group. 


Tommy's Tara's Nick's 
Plants Plants Plants 
Sample 24.2 25.4 24.4 
Mean 
sae Tey, 18.3 Lee 
Variance 


Next, calculate the variance of the three group means (Calculate the 
variance of 24.2, 25.4, and 24.4). Variance of the group means = 
0.413 = s,." 


Then MSpetween = NS2° = (5) (0.413) where n = 5 is the sample 
size (number of plants each child grew). 


Calculate the mean of the three sample variances (Calculate the mean 
of 11.7, 18.3, and 16.3). Mean of the sample variances = 15.433 


= So peoled 
Then MS within = a eae = 5.430. 


The F statistic (or F ratio) is 


2 


FF — MStetween _ _m-S2”_ _ (5)-(0.413) __ gq 494 


MS within 8 ncoled 15.433 
The dfs for the numerator = the number of groups — 1 = 3—1= 2 


The dfs for the denominator = 
the total number of samples — the number of groups = 15 — 3 = 12 


The distribution for the test is F’2 12 and the F statistic is F = 0.134 
The p-value is P(F' > 0.134) = 0.8759. 


Decision: Since a = 0.03 and the p-value = 0.8759, do not reject 
H,. (Why?) 


Conclusion: With a 3% the level of significance, from the sample 
data, the evidence is not sufficient to conclude that the mean heights of 
the bean plants are different. 


(This experiment was actually done by three classmates of the son of 
one of the authors.) 


Another fourth grader also grew bean plants but this time in a jelly-like 
mass. The heights were (in inches) 24, 28, 25, 30, and 32. 
Exercise: 


Problem: 

Do a One-Way ANOVA test on the 4 groups. You may use your 
calculator or computer to perform the test. Are the heights of the bean 
plants different? Use a solution sheet. 


Solution: 


e F'=0.9496 


e p-value = 0.4402 


From the sample data, the evidence is not sufficient to conclude that 
the mean heights of the bean plants are different. 


Optional Classroom Activity 


From the class, create four groups of the same size as follows: men under 
22, men at least 22, women under 22, women at least 22. Have each member 
of each group record the number of states in the United States he or she has 
visited. Run an ANOVA test to determine if the average number of states 
visited in the four groups are the same. Test at a 1% level of significance. 
Use one of the solution sheets at the end of the chapter (after the 
homework). 


Test of Two Variances 

This module provides the assumptions to be considered in order to calculate 
a Test of Two Variances and how to execute the Test of Two Variances. An 
example is provided to help clarify the concept. 


Another of the uses of the F distribution is testing two variances. It is often 
desirable to compare two variances rather than two averages. For instance, 
college administrators would like two college professors grading exams to 
have the same variation in their grading. In order for a lid to fit a container, 
the variation in the lid and the container should be the same. A supermarket 
might be interested in the variability of check-out times for two checkers. 


In order to perform a F test of two variances, it is important that the 
following are true: 


1. The populations from which the two samples are drawn are normally 
distributed. 
2. The two populations are independent of each other. 


Suppose we sample randomly from two independent normal populations. 
Let o? and o? be the population variances and s? and s2 be the sample 
variances. Let the sample sizes be n; and ng. Since we are interested in 
comparing the two sample variances, we use the F ratio 


F has the distribution F' ~ F'(n, — 1, n2 — 1) 
where n; — 1 are the degrees of freedom for the numerator and nz — 1 are 
the degrees of freedom for the denominator. 


If the null hypothesis is 7 = 0, then the F-Ratio becomes 


Pea 
(1)? } _ (1)? 


(s2)? 


Note:The F ratio could also be (1)? 
$1 


. It depends on Hy, and on which 


sample variance is larger. 


If the two populations have equal variances, then s? and 83 are close in 


ao 
value and fF’ = ma is close to 1. But if the two population variances are 
$2 


very different, s? and s2 tend to be very different, too. Choosing s? as the 


2 
. . Ss 
larger sample variance causes the ratio et) 


(s2)” 
83 are far apart, then F’ = (a is a large number. 
$2 


to be greater than 1. If 3? and 


Therefore, if F is close to 1, the evidence favors the null hypothesis (the 
two population variances are equal). But if F is much larger than 1, then the 
evidence is against the null hypothesis. 


A test of two variances may be left, right, or two-tailed. 


Example: 

Two college instructors are interested in whether or not there is any 
variation in the way they grade math exams. They each grade the same set 
of 30 exams. The first instructor's grades have a variance of 52.3. The 
second instructor's grades have a variance of 89.9. 

Exercise: 


Problem: 


Test the claim that the first instructor's variance is smaller. (In most 
colleges, it is desirable for the variances of exam grades to be nearly 
the same among instructors.) The level of significance is 10%. 


Solution: 


Let 1 and 2 be the subscripts that indicate the first and second 
instructor, respectively. 


ny=ng = 30. 
eee) ae) 
H,: of = 05 and Hy: a{<05 


Calculate the test statistic: By the null hypothesis (7 = a3) , the F 


Statistic is 


28] 
F= Lae oS — 323 _ 0.5818 


Distribution for the test: F9 99 where n; — 1 = 29 and 
Ny —1= 29. 


Graph: This test is left tailed. 
Draw the graph labeling and shading appropriately. 


p-value = 0.0753 


0.5818 


Probability statement: p-value = P (F' < 0.5818) = 0.0753 
Compare a and the p-value: a = 0.10 a > p-value. 


Make a decision: Since a > p-value, reject H,. 


Conclusion: With a 10% level of significance, from the data, there is 
sufficient evidence to conclude that the variance in grades for the first 
instructor is smaller. 


TI-83+ and TI-84: Press STAT and arrow over to TESTS. Arrow 
down to D:2-SampFTest. Press ENTER. Arrow to Stats and 


press ENTER. For Sx1, n1, Sx2, and n2, enter 4/ (52.3), 30, 
,/ (89.9), and 30. Press ENTER after each. Arrow to 01: and <o2. 
Press ENTER. Arrow down to Calculate and press ENTER. 


F = 0.5818 and p-value = 0.0753. Do the procedure again and try 
Draw instead of Calculate. 


Summary 

This module provides a summary of F Distribution and One-Way ANOVA 
as a part of Collaborative Statistics collection (col10522) by Barbara 
Illowsky and Susan Dean. 


e A One-Way ANOVA hypothesis test determines if several population 
means are equal. The distribution for the test is the F distribution with 
2 different degrees of freedom. 
Assumptions: 


1. Each population from which a sample is taken is assumed to be 
normal. 

2. Each sample is randomly selected and independent. 

3. The populations are assumed to have equal standard deviations 
(or variances) 


e A Test of Two Variances hypothesis test determines if two variances 
are the same. The distribution for the hypothesis test is the F 
distribution with 2 different degrees of freedom. 

Assumptions: 


1. The populations from which the two samples are drawn are 
normally distributed. 
2. The two populations are independent of each other. 


Practice: ANOVA 
This module provides a practice on F Distribution and One-Way ANOVA as a part of 
Collaborative Statistics collection (col10522) by Barbara Illowsky and Susan Dean. 


Student Learning Outcome 


e The student will conduct a One-Way ANOVA hypothesis test. 


Given 


Suppose a group is interested in determining whether teenagers obtain their drivers 
licenses at approximately the same average age across the country. Suppose that the 
following data are randomly collected from five teenagers in each region of the 
country. The numbers represent the age at which teenagers obtained their drivers 
licenses. 


Northeast South West Central East 
16.3 16.9 16.4 16.2 La 
16.1 16.5 16.5 16.6 17.2 
16.4 16.4 16.6 16.5 16.6 
16.5 16.2 16.1 16.4 16.8 
r= 
3 = 
Hypothesis 
Exercise: 


Problem: State the hypotheses. 


fis Pee 
Hie 


Data Entry 


Enter the data into your calculator or computer. 
Exercise: 


Problem: degrees of freedom - numerator: df(n) = 


Solution: 


df(1) =4 


Exercise: 


Problem: degrees of freedom - denominator: df(d) = 


Solution: 


df (2) =15 


Exercise: 
Problem: F test statistic = 


Solution: 


Test statistic = F' = 4.22 


Exercise: 


Problem: p-value = 


Solution: 


0.017 


Decisions and Conclusions 


State the decisions and conclusions (in complete sentences) for the following 
preconceived levels of a . 
Exercise: 


Problem: a = 0.05 

Decision: 

Conclusion: 
Exercise: 

Problem: a = 0.01 

Decision: 


Conclusion: 


Analysis of Variance (ANOVA) Homework Link 


Link to homework questions in Homework Collection/Book for Analysis 
(ANOVA) Chapter 13 of Collaborative Statistics for R. Bloom 


Chapter 13 Review Questions Link (Collaborative Statistics; R. Bloom 
custom version) 


Link to review questions in Homework Collection/Book for Analysis 
(ANOVA) Chapter 13 of Collaborative Statistics for R. Bloom 


Data Sets 

This module provides data sets for use with the Collaborative Statistics 
textbook/collection. Data sets include a series of recorded motorcycle race and 
practice lap times as well as IPO stock prices. 


Lap Times 


The following tables provide lap times from Terri Vogel's Log Book. Times are 
recorded in seconds for 2.5-mile laps completed in a series of races and practice 
runs. 


1 2 3 4 5 6 7 
ons 135 | 130 | 131 | 132 | 130 | 131 | 133 
as 134 | 131 | 131 | 129 | 128 | 128 | 129 
— 129 | 128 | 127 | 127 | 130 | 127 | 129 
oa- 125 | 125 | 126 | 125 | 124 | 125 | 125 
aa 133 | 132 | 132 | 132 | 131 | 130 | 132 
gace | 130 | 130 | 130 | 129 | 129 | 130 | 129 
Race 


132 131 133 131 134 134 131 


132 


135 


132 


134 


128 


132 


136 


129 


134 


129 


130 


130 


131 


131 


130 


127 


131 


129 


129 


131 


129 


129 


ia, 


131 


132 


130 


128 


131 


129 


129 


132 


130 


129 


128 


132 


131 


130 


128 


131 


129 


128 


131 


130 


129 


126 


130 


130 


131 


128 


132 


129 


128 


132 


133 


129 


127 


131 


129 


130 


129 


130 


129 


129 


132 


133 


129 


124 


130 


129 


130 


128 


130 


129 


129 


132 


127 


128 


Lap Lap Lap Lap Lap Lap Lap 
1 2 3 4 5 6 7 


Race 


20 131 128 130 128 129 130 130 


Race Lap Times (in Seconds) 


1 2 3 4 ) 6 7 
—— 142 143 180 137 134 134 ~=© 172 
aes 140 | 135 | 134 | 133 | 128 | 128 | 131 
ae 130 133 | 130 | 128 | 135 | 133 | 133 
gence | 141 | 136 | 137 | 136 | 136 | 136 | 145 
sae 140 138 136 137 135 134 134 
pracuce | 142 | 142 | 139 | 138 | 129 | 129 | 127 
Pracuce | 139 | 137 | 135 | 135 | 137 | 134 | 135 
Practice 


8 143 136 134 133 134 133 132 


Practice 
9 


Practice 
10 


Practice 
11 


Practice 
12 


Practice 
13 


Practice 
14 


Practice 
15 


Practice Lap Times (in Seconds) 


Stock Prices 


131 


143 


132 


149 


133 


138 


130 


139 


133 


144 


132 


136 


128 


139 


131 


144 


137 


133 


129 


138 


129 


139 


133 


133 


127 


138 


128 


138 


134 


132 


128 


137 


127 


138 


130 


131 


127 


138 


126 


137 


131 


131 


The following table lists initial public offering (IPO) stock prices for all 1999 
stocks that at least doubled in value during the first day of trading. This is 


historical data. 


$17.00 


$23.00 


$14.00 


$16.00 


$12.00 


$26.00 


$20.00 
$18.00 
$18.00 
$16.00 
$16.00 
$17.00 
$16.00 
$8.00 

$19.00 
$13.00 
$21.00 
$17.00 
$14.00 
$15.00 
$24.00 
$14.00 
$24.00 
$16.00 
$8.00 


$21.00 


$22.00 
$21.00 
$17.00 
$10.00 
$14.00 
$16.00 
$18.00 
$20.00 
$15.00 
$14.00 
$17.00 
$19.00 
$21.00 
$23.00 
$20.00 
$19.00 
$16.00 
$15.00 
$23.00 


$34.00 


$14.00 
$21.00 
$15.00 
$20.00 
$15.00 
$15.00 
$9.00 

$17.00 
$21.00 
$15.00 
$28.00 
$18.00 
$12.00 
$14.00 
$14.00 
$16.00 
$8.00 

$7.00 

$12.00 


$16.00 


$15.00 
$19.00 
$25.00 
$12.00 
$20.00 
$15.00 
$18.00 
$14.00 
$12.00 
$14.00 
$17.00 
$17.00 
$18.00 
$16.00 
$14.00 
$38.00 
$18.00 
$19.00 
$18.00 


$26.00 


$22.00 
$15.00 
$14.00 
$16.00 
$20.00 
$19.00 
$18.00 
$11.00 
$8.00 

$13.41 
$19.00 
$15.00 
$24.00 
$12.00 
$15.00 
$20.00 
$17.00 
$12.00 
$20.00 


$14.00 


$18.00 
$21.00 
$30.00 
$17.44 
$16.00 
$48.00 
$20.00 
$16.00 
$16.00 
$28.00 


$16.00 


IPO Offer Prices 


Note:Data compiled by Jay R. Ritter of Univ. of Florida using data from 
Securities Data Co. and Bloomberg. 


Symbols and their Meanings 
This module defines symbols used throughout the Collaborative Statistics 
textbook. 


Chapter 
(1st used) Symbol Spoken Meaning 
Sampling The square root 
and Data Vv of os 
Sampling Pj pee : 
Sacha 1 i (a specific 
number) 
Descriptive the first 
Statistics Ql uae oue quartile 
Descriptive the second 
Statistics Q2 Qamewe quartile 
Descriptive : the third 
Statistics Q3 ae tae quartile 
Descriptive IQR inter-quartile Q3- 
Statistics range Q1i=IQR 
Descriptive “ “ba sample 
Statistics mean 
Descriptive P ani population 
Statistics mean 


Chapter 
(1st used) 


Descriptive 
Statistics 


Descriptive 
Statistics 


Descriptive 
Statistics 


Descriptive 
Statistics 


Descriptive 
Statistics 


Probability 
Topics 


Probability 
Topics 


Probability 
Topics 


Probability 
Topics 


Symbol 


S Sy SX 


O Ox OX 


{} 


Spoken 


s-squared 


sigma 


sigma-squared 


capital sigma 


brackets 


Event A 


probability of 
A 


Meaning 
sample 
standard 


deviation 


sample 
variance 


population 
standard 


deviation 


population 
variance 


sum 


set notation 


sample 
space 


event A 


probability 
of A 
occurring 


Chapter 
(1st used) 


Probability 
Topics 


Probability 
Topics 


Probability 
Topics 


Probability 
Topics 


Probability 
Topics 


Probability 
Topics 


Probability 
Topics 


Discrete 
Random 
Variables 


Symbol 


P(A| B) 


P (Aor B) 


P (Aand B) 


A? 


PDF 


Spoken 


probability of 
A given B 


prob. of A or B 


prob. of A and 
B 


A-prime, 
complement of 
A 


prob. of 
complement of 
A 


green on first 
pick 


prob. of green 
on first pick 


prob. 
distribution 
function 


Meaning 


prob. of A 
occurring 
given B has 
occurred 


prob. of A 
or B or both 
occurring 
prob. of 
both A and 


B occurring 
(same time) 


complement 
of A, notA 


same 


same 


same 


same 


Chapter 
(1st used) 


Discrete 
Random 
Variables 


Discrete 
Random 
Variables 


Discrete 
Random 
Variables 


Discrete 
Random 
Variables 


Discrete 
Random 
Variables 


Discrete 
Random 
Variables 


Discrete 
Random 
Variables 


Discrete 
Random 
Variables 


Symbol 


IV 


Spoken 


the distribution 


of X 


binomial 


distribution 


geometric 


distribution 


hypergeometric 


dist. 


Poisson dist. 


Lambda 


greater than or 


equal to 


Meaning 


the random 
variable X 


same 


same 


same 


same 


same 


average of 


Poisson 
distribution 


same 


Chapter 
(1st used) 


Discrete 
Random 
Variables 


Discrete 
Random 
Variables 


Discrete 
Random 
Variables 


Continuous 
Random 
Variables 


Continuous 
Random 
Variables 


Continuous 
Random 
Variables 


Continuous 
Random 
Variables 


Continuous 
Random 
Variables 


Symbol 


IA 


Exp 


Spoken 


less than or 
equal to 


equal to 


not equal to 


f of x 


prob. density 
function 


uniform 
distribution 


exponential 
distribution 


Meaning 


same 


same 


same 


function of 
x 


same 


same 


same 


critical 
value 


Chapter 
(1st used) 


Continuous 
Random 
Variables 


Continuous 
Random 
Variables 


The Normal 
Distribution 


The Normal 
Distribution 


The Normal 
Distribution 


The Central 
Limit 
Theorem 


The Central 
Limit 
Theorem 


The Central 
Limit 
Theorem 
The Central 
Limit 
Theorem 


CLT 


Le 


Me 


Spoken 


f of x equals 


normal 
distribution 


Z-SCOre 


standard 
normal dist. 


Central Limit 


Theorem 


X-bar 


mean of X 


mean of X-bar 


Meaning 


same 


decay rate 
(for exp. 
dist.) 


same 


same 


same 


same 


the random 
variable X- 
bar 


the average 
of X 


the average 
of X-bar 


Chapter 
(1st used) 


The Central 
Limit 
Theorem 


The Central 
Limit 
Theorem 


The Central 
Limit 
Theorem 
The Central 
Limit 
Theorem 


Confidence 
Intervals 


Confidence 
Intervals 


Confidence 
Intervals 


Confidence 
Intervals 


Confidence 
Intervals 


Confidence 
Intervals 


Symbol 


Or 


Or 


dX 


CL 


CI 


EKBM 


df 


Spoken 


standard 
deviation of X 


standard 
deviation of X- 
bar 


sum of X 


sum of x 
confidence 
level 


confidence 
interval 


error bound for 
a mean 


error bound for 
a proportion 


student-t 
distribution 


degrees of 
freedom 


Meaning 


same 


same 


same 


same 


same 


same 


same 


same 


same 


same 


Chapter 
(1st used) 


Confidence 
Intervals 


Confidence 
Intervals 


Confidence 
Intervals 


Hypothesis 
Testing 


Hypothesis 
Testing 


Hypothesis 
Testing 


Hypothesis 
Testing 


Hypothesis 
Testing 


Hypothesis 
Testing 


Ay, 


X1—X2 


Spoken 


student-t with 
a/2 area in 
right tail 


p-prime; p-hat 


q-prime; q-hat 


H-naught, H- 
sub 0 


H-a, H-sub a 


H-1, H-sub 1 


alpha 


beta 


X1-bar minus 
X2-bar 


Meaning 


same 


sample 
proportion 
of success 


sample 
proportion 
of failure 


null 
hypothesis 


alternate 
hypothesis 


alternate 
hypothesis 


probability 
of Type I 
error 


probability 
of Type II 
error 


difference 
in sample 
means 


Chapter 
(1st used) 


Chi-Square 
Distribution 


Linear 
Regression 
and 
Correlation 


Symbol 

1 — P2 
P’,—P” 
P1 — P2 
x2 

O 

E 
y=a+bx 
y 

r 


Spoken 


mu-1 minus 
mu-2 


P1-prime 
minus P2- 
prime 


pl minus p2 


Ky-square 


Observed 


Expected 


y equals a plus 
b-x 


y-hat 


correlation 
coefficient 


Meaning 


difference 
in 
population 
means 


difference 
in sample 
proportions 


difference 
in 


population 
proportions 


Chi-square 


Observed 
frequency 


Expected 
frequency 


equation of 
a line 


estimated 
value of y 


same 


Chapter 


(1st used) Symbol 
E 
SSE 
1.9s 

F- 

Distribution F 

and 

ANOVA 


Symbols and their Meanings 


Spoken 
error 


Sum of 
Squared Errors 


1.9 times s 


F-ratio 


Meaning 


same 


same 


cut-off 
value for 
outliers 


F ratio 


English Phrases Written Mathematically 
This module provides an overview of commonly used phrases in statistics 
and their mathematical equivalents. 


English Phrases Written Mathematically 


When the English says: Interpret this as: 
Xis at least 4. X>A4 
The minimum of X is 4. X>A4 
X is no less than 4. X>A4 
X is greater than or equal to 4. X>A4 
X is at most 4. X<A4 
The maximum of X is 4. X<4 
Xis no more than 4. X<4 
X is less than or equal to 4. X<A4 
X does not exceed 4. X<A4 


Xis greater than 4. X>A4 


When the English says: Interpret this as: 


X is more than 4. X>A4 
Xexceeds 4. X>A4 
Xis less than 4. X<A4 
There are fewer X than 4. X<A4 
Xis 4. X=A4 
Xis equal to 4. X=4 
Xis the same as 4. » a. 
Xis not 4. XA 
Xis not equal to 4. X #4 
Xis not the same as 4. X#A4 


Xis different than 4. XA 


Formulas 

This module provides an overview of Statistics Formulas used as a part of 
Collaborative Statistics collection (col10522) by Barbara Illowsky and 
Susan Dean. 

Formula 

Factorial 


n! = n(n — 1)(n — 2)... (1) 


O!=1 
Formula 
Combinations 


=e 


Formula 
Binomial Distribution 


X~B(n,p) 


PI XB! pg © Mone 20,4 2 on05 
Formula 
Geometric Distribution 


X~-G(p) 


21 0, Ge x) = 9° p fore = 1.9. 3.33 
Formula 
Hypergeometric Distribution 


X~H (r,b,n) 
a) 
y cdi WO Gens se (te ; 
(=*) = ("5 
Formula 


Poisson Distribution 


X~P (u) 


P(X=2)=4> 


z! 
Formula 
Uniform Distribution 


X~U(a, b) 


f(X) =po,a<2<b 
Formula 


Exponential Distribution 
X ~ Exp(m) 


{= me" ame Oe 0 
Formula 
Normal Distribution 


X~N(p, 07) 


1 cea? 
fix) =——e ww , -w<2< 0 
oV or 


Formula 
Gamma Function 


DZ \af, ee dee ee 

r(4) = va 

I'(m +1) = m! for m, a nonnegative integer 
otherwise: (a + 1) = aI'(a) 

Formula 


Student-t Distribution 


X ~tae¢ 


Z-N(0,1) , Y-X2, ,n = degrees of freedom 
Formula 
Chi-Square Distribution 


X~X?2, 


n-2 —-2 
Vi () = Era) ,x > 0, n= positive integer and degrees of freedom 
2 


Formula 
F Distribution 


X ~Fat(n),df(d) 
df(n) =degrees of freedom for the numerator 


df(d) =degrees of freedom for the denominator 


Y, 
Pe — We > Y, W are chi-square 


Notes for the TI-83, 83+, 84 Calculator 
Notes and tips for using TI-83, TI-83+, and TI-84 calculators for statistics 
applications. 


Quick Tips 
Legend 
. fi } 


represents a button press 
e [| | represents yellow command or green letter behind a key 
e < >represents items on the screen 


To adjust the contrast 
Press 


| 2nd | 
, then hold 


to increase the contrast or 


to decrease the contrast. 


To capitalize letters and words 
Press 


ALPHA) 


to get one capital letter, or press 


, then 


ALPHA] 


to set all button presses to capital letters. You can return to the top-level 
button values by pressing 


(ALPHA) 
again. 


To correct a mistake 
If you hit a wrong button, just hit 


and start again. 


To write in scientific notation 
Numbers in scientific notation are expressed on the TI-83, 83+, and 84 
using E notation, such that... 


© 4321E4=4.321 x 104 
e 4.321 E-4= 4.321 x 10-4 


To transfer programs or equations from one calculator to another: 
Both calculators: Insert your respective end of the link cable cable and 
press 


, then [LINK]. 
Calculator receiving information: 


Use the arrows to navigate to and select<RECEIVE> 
Press 


Calculator sending information: 


Press appropriate number or letter. 


Use up and down arrows to access the appropriate item. 
Press to select item to transfer. 


Press right arrow to navigate to and select<TRANSMIT>. 
Press 


Note:ERROR 35 LINK generally means that the cables have not been 
inserted far enough. 


Both calculators: Insert your respective end of the link cable cable Both 
calculators: press 


| 2nd 
, then [QUIT ] To exit when done. 


Manipulating One-Variable Statistics 


Note: These directions are for entering data with the built-in statistical 
program. 


Data Frequency 


-2 10 


Data Frequency 


-1 3 
0 4 
1 5 
3 8 


Sample DataWe are manipulating 1-variable statistics. 
To begin: 
Turn on the calculator. 


Access Statistics mode. 


STAT 


Select<4:C1lrList>to clear data from lists, if desired. 


Enter list [ L1]to be cleared. 


Display last instruction. 


, [ENTRY] 
Continue clearing remaining lists in the same fashion, if desired. 


GB 
| 2nd | 
, eae, 
Access statistics mode. 
STAT 
Select@ i Gale = 
ENTER] 
Enter [L1]. (You may [L1]) 
data. Data need to o Type in a data value and enter it. 
values go arrow over (For negative numbers, use the 
into to negate (-) key at the bottom of the 


keypad) 


=) 


ans) 


’ 


ENTER) 


o Continue in the same manner until 
all data values are entered. 


In[ L2 ], enter the (eat). 
frequencies for o Type in a frequency and enter it. (If a 
each data value in data value appears only once, the 


frequency is "1") 


eae) 


ENTER] 


o Continue in the same manner until all 
data values are entered. 


Access Statistics mode. 


STAT 
Navigate to<CALC> 
Access<1:1-var Stats> 


ENTER) 


Indicate that the data is in[ L1 ]... 


Exp 
,» [LI], 


..and indicate that the frequencies are in[ L2 }. 


| 2nd | 
» [L2], 


The statistics should be displayed. You may arrow down to get remaining 
Statistics. Repeat as necessary. 


Drawing Histograms 


Note:We will assume that the data is already entered 


We will construct 2 histograms with the built-in STATPLOT application. 
The first way will use the default ZOOM. The second way will involve 
customizing a new graph. 


Access graphing mode. 


, [STAT PLOT] 
Select<1: plot 1>To access plotting - first graph. 


Gi 


Use the arrows navigate go to<ON>to turn on Plot 1. 


<ON>. 


ENTER] 


Use the arrows to go to the histogram picture and select the histogram. 
ENTER] 


Use the arrows to navigate to<Xlist> 
If "L1" is not selected, select it. 


| 2nd | 
,» [LI], 


Gi 


Use the arrows to navigate to<Freq>. 
Assign the frequencies to[ L2 ]. 


| 2nd | 
» [L2], 


ENTER] 


Go back to access other graphs. 


, (stat PEO] 
Use the arrows to turn off the remaining plots. 
Be sure to deselect or clear all equations before graphing. 


To deselect equations: 


Access the list of equations. 


Select each equal sign (=). 


GA 
Cs 
ENTER] 


Continue, until all equations are deselected. 
To clear equations: 


Access the list of equations. 


Ys 


Use the arrow keys to navigate to the right of each equal sign (=) and 
clear them. 


Repeat until all equations are deleted. 
To draw default histogram: 


Access the ZOOM menu. 


CD 


Select<9 : ZoomStat> 


1) 


The histogram will show with a window automatically set. 


To draw custom histogram: 


Access to set the graph parameters. 
ie) Ain = —2.5 
Oo A may = 3.0 
°o Xs) = 1 (width of bars) 
° Ynin = 0 
° Ynax = 10 
o Y;.) = 1 (spacing of tick marks on y-axis) 
2 X res =1 


Access to see the histogram. 


To draw box plots: 


Access graphing mode. 


, [STAT PLOT] 
Select<1:Plot 1>to access the first graph. 


Gi 


Use the arrows to select<ON>and turn on Plot 1. 


ENTER] 


Use the arrows to select the box plot picture and enable it. 


Use the arrows to navigate to<Xlist> 
If "L1" is not selected, select it. 


2nd 
a. 


Use the arrows to navigate to<Freq>. 
Indicate that the frequencies are in[ L2]. 


» [L2], 


Go back to access other graphs. 


, [STAT PLOT | 
Be sure to deselect or clear all equations using the method 
before graphing mentioned above. 
View the box plot. 


(GRAPH 
, [STAT PLOT] 


Linear Regression 


Sample Data 


The following data is real. The percent of declared ethnic minority students 
at De Anza College for selected years from 1970 - 1995 was: 


Year Student Ethnic Minority Percentage 
1970 14.13 
1973 12.27 
1976 14.08 
1979 18.16 
1982 27.64 
1983 28.72 
1986 31.86 
1989 33.14 
1992 45.37 
1995 93.1 


The independent variable is "Year," while the independent variable is 
"Student Ethnic Minority Percent." 


Student Ethnic Minority Percentage 


60 Stud. Ethnic Min. Perc. 


Percent 


1960 1970 1980 1990 2000 


Year 


By hand, verify the scatterplot above. 


Note:The TI-83 has a built-in linear regression feature, which allows the 
data to be edited. The x-values will be in 


[L1] 
; the y-values in 


[L2] 


To enter data and do linear regression: 


ON Turns calculator on 


Before accessing this program, be sure to turn off 


all plots. o Access graphing 


mada 


11U0Ue. 


, [STAT PLOT] 
o Turn off all plots. 


as) 
Round to 3 decimal 
places. To do so: © Access the mode menu. 
| MODE | 


, [STAT PLOT] 
o Navigate to <Float> and then to the right 
to <3>. 


o All numbers will be rounded to 3 decimal 
places until changed. 


Enter statistics mode and clear lists[ L1 ]and[L2], as describe above. 


Enter editing mode to insert values for x and y. 


STAT 
ENTER] 
Enter each value. Press to continue. 
Gi 
To display the correlation coefficient: 
Access the catalog. 
| 2nd | 
, [CATALOG ] 
Arrow down and select<DlagnosticOn> 
GS 
ENTER] 


ENTER] 


STAT 


Tandr2will be displayed during regression calculations. 
Access linear regression. 


STAT 


Select the form ofy = a + bx 


aud) 
ENTER] 
The display will show: 
LinReg 
°y=a-+ bz 
e a = —3176.909 
¢« b=1.617 
er? = 0.924 
« r= 0.961 


This means the Line of Best Fit (Least Squares Line) is: 


e y = —3176.909 + 1.6172 
e Percent = —3176.909 + 1.617(year #) 


The correlation coefficient r = 0.961 
To see the scatter plot: 


Access graphing mode. 


| 2nd 
, [STAT PLOT] 


Select<1: plot 1>To access plotting - first graph. 


Navigate and select<ON>to turn on Plot 1. 
<ON> 


Navigate to the first picture. 
Select the scatter plot. 


ENTER] 


Navigate to<Xlist> 
If[L1]is not selected, press ,| L1 ]to select it. 
L 2nd | 


Confirm that the data values are in[ L1]. 
<ON> 


ENTER] 


Navigate to<Ylist> 
Select that the frequencies are in[ L2 ]. 


» [L2], 


Go back to access other graphs. 


ro rar ni aAwTT 


, SiReUA 
Use the arrows to turn off the remaining plots. 
Access___to set the graph 


parameters. ° Xmin = 1970 

Oo XK way = 2000 

© Xs = 10 (spacing of tick marks on 
x-axis) 

& Yan = 0.05 

2 Vane = 60 

o Y,. = 10 (spacing of tick marks on 
y-axis) 

2 X yes =1 


Be sure to deselect or clear all equations before graphing, using the 
instructions above. 
Press to see the scatter plot. 


To see the regression graph: 


Access the equation menu. The regression equation will be put into 
YI: 


Y= 


Access the vars menu and navigate to<5: Statistics> 


Navigate to<EQ>. 
E<allee contains the regression equation which will be entered in 
RegEQ> bak 


Gi 


Press@Z). The regression line will be superimposed over scatter plot. 


To see the residuals and use them to calculate the critical point for an 
outlier: 


Access the list. RESID will be an item on the menu. 
Navigate to it. 


, erSail, 

<RESID> 
Confirm twice to view the list of residuals. Use the arrows to select 
them. 


ENTER] 
Gi 
The critical point for an 1.9V 2= where: 
outlier is: o m=number of pairs of 
data 
o SSE = sum of the squared 
errors 


o S~ residual? 


Store the residuals in[ L3 ]. 


STOP 


Calculate the (residual)? _ Note that. — 2 = 8 
n—2 


Store this value in| L4 ]. 


STOP 
| 2nd 
» ey 


Calculate the critical value using the equation above. 


E E 


wy wy wy 
- 


2: 


Verify that the calculator displays: 7.642669563. This is the critical value. 


Compare the [L3]to 7.64. If the absolute value is greater than 7.64, 


absolute value of then the (x, y) corresponding point is an outlier. In 
each residual this case, none of the points is an outlier. 
value in 


To obtain estimates of y for various x-values: 
There are various ways to determine estimates for "y". One way is to 
substitute values for "x" in the equation. Another way is to use the 


on the graph of the regression line. 
TI-83, 83+, 84 instructions for distributions and tests 


Distributions 
Access DISTR (for Distributions"). 


For technical assistance, visit the Texas Instruments website at 
http://www.ti.com and enter your calculator model into the "search" box. 
Binomial Distribution 


e binompdf(n,p, X) corresponds to P(X = x) 

e binomcdf(n,p, X) corresponds to P(X < x) 

e To see a list of all probabilities for x: 0,1,...,n, leave off the "x" 
parameter. 


Poisson Distribution 


e poissonpdf(A, xX) corresponds to P(X = x) 
e poissoncdf (A, xX) corresponds to P(X < x) 


Continuous Distributions (general) 


e —oo uses the value -1EE99 for left bound 
¢ oo uses the value 1EE99 for right bound 


Normal Distribution 


normalpdf(x,U,0) yields a probability density function value 
(only useful to plot the normal curve, in which case "xX" is the variable) 
normalcdf(left bound, right bound, U,©o) corresponds 
to P(left bound < X < right bound) 

normalcdf(left bound, right bound) corresponds to 
P(left bound < Z < right bound) - standard normal 

invNorm(p,U, 0) yields the critical value, k: P(X < k) =p 
invNorm(p) yields the critical value, k: P(Z < k) = p for the 
standard normal 


Student-t Distribution 


e tpdf(x, df) yields the probability density function value (only 


useful to plot the student-t curve, in which case "X" is the variable) 


e tcdf(left bound, right bound, df) corresponds to P(left 


bound < t < right bound) 


Chi-square Distribution 


e X*pdf(x, df) yields the probability density function value (only 


useful to plot the chi curve, in which case "Xx" is the variable) 


¢ X*cdf(left bound, right bound, df) corresponds to 


P(left bound < X? < right bound) 


F Distribution 


e Fpdf(x,dfnum, dfdenom) yields the probability density function 


value (only useful to plot the F curve, in which case "X" is the 
variable) 


e Fcdf(left bound, right bound, dfnum, dfdenom) 


corresponds to P(left bound < F < right bound) 


Tests and Confidence Intervals 


Access STAT and TESTS. 


For the Confidence Intervals and Hypothesis Tests, you may enter the data 
into the appropriate lists and press DATA to have the calculator find the 
sample means and standard deviations. Or, you may enter the sample means 
and sample standard deviations directly by pressing STAT once in the 
appropriate tests. 

Confidence Intervals 


e ZInterval is the confidence interval for mean when o is known 

e TInterval is the confidence interval for mean when o is unknown; 
s estimates o. 

e 1-PropZInt is the confidence interval for proportion 


Note:The confidence levels should be given as percents (ex. enter "95" or 
"95" for a 95% confidence level). 


Hypothesis Tests 


e Z-TeSt is the hypothesis test for single mean when o is known 

e T-Test is the hypothesis test for single mean when o is unknown; s 
estimates o. 

e 2-SampZTest is the hypothesis test for 2 independent means when 
both o's are known 

e 2-SampTTest is the hypothesis test for 2 independent means when 
both o's are unknown 

e 1-PropZTest is the hypothesis test for single proportion. 

e 2-PropZTest is the hypothesis test for 2 proportions. 

e X*-Test is the hypothesis test for independence. 

e X*GOF-Test is the hypothesis test for goodness-of-fit (TI-84+ only). 

e LinRegTTEST is the hypothesis test for Linear Regression (TI-84+ 
only). 


Note:Input the null hypothesis value in the row below "Inpt." For a test 
of a single mean, "[1@" represents the null hypothesis. For a test of a single 
proportion, "©" represents the null hypothesis. Enter the alternate 
hypothesis on the bottom row. 


Tables 


Note:When you are finished with the table link, use the back button on 
your browser to return here. 


Tables (NIST/SEMATECH e-Handbook of Statistical Methods, 
http://www. itl nist.gov/div898/handbook/, January 3, 2009) 


Student-t table 

Normal table 

Chi-Square table 

F-table 

All four tables can be accessed by going to 

http://www.itl nist. gov/div898/handbook/eda/section3/eda367.htm 


95% Critical Values of the Sample Correlation Coefficient Table 


95% Critical Values of the Sample Correlation Coefficient 


Note:The url for this table is http://cnx.org/content/m17098/latest/ 


